-- Logs begin at Mon 2022-10-10 16:18:21 UTC, end at Mon 2022-10-10 17:13:34 UTC. -- Oct 10 16:45:08.531138 dv-cinder-834540-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 10 16:45:08.542036 dv-cinder-834540-2-smb devstack@keystone.service[81426]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 16:45:08 2022] *** Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: nodename: dv-cinder-834540-2-smb Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: machine: x86_64 Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: clock source: unix Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: pcre jit disabled Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: detected number of CPU cores: 4 Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: current working directory: / Oct 10 16:45:08.544116 dv-cinder-834540-2-smb devstack@keystone.service[81426]: detected binary path: /usr/bin/uwsgi-core Oct 10 16:45:08.544672 dv-cinder-834540-2-smb devstack@keystone.service[81426]: your processes number limit is 47680 Oct 10 16:45:08.544672 dv-cinder-834540-2-smb devstack@keystone.service[81426]: your memory page size is 4096 bytes Oct 10 16:45:08.544672 dv-cinder-834540-2-smb devstack@keystone.service[81426]: detected max file descriptor number: 2048 Oct 10 16:45:08.544672 dv-cinder-834540-2-smb devstack@keystone.service[81426]: lock engine: pthread robust mutexes Oct 10 16:45:08.544672 dv-cinder-834540-2-smb devstack@keystone.service[81426]: thunder lock: enabled Oct 10 16:45:08.544672 dv-cinder-834540-2-smb devstack@keystone.service[81426]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 10 16:45:08.544672 dv-cinder-834540-2-smb devstack@keystone.service[81426]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 16:45:08.583765 dv-cinder-834540-2-smb devstack@keystone.service[81426]: Python main interpreter initialized at 0x5610bcd559c0 Oct 10 16:45:08.583765 dv-cinder-834540-2-smb devstack@keystone.service[81426]: python threads support enabled Oct 10 16:45:08.583765 dv-cinder-834540-2-smb devstack@keystone.service[81426]: your server socket listen backlog is limited to 100 connections Oct 10 16:45:08.583765 dv-cinder-834540-2-smb devstack@keystone.service[81426]: your mercy for graceful operations on workers is 90 seconds Oct 10 16:45:08.584092 dv-cinder-834540-2-smb devstack@keystone.service[81426]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 16:45:08.584186 dv-cinder-834540-2-smb devstack@keystone.service[81426]: *** Operational MODE: preforking *** Oct 10 16:45:08.584456 dv-cinder-834540-2-smb devstack@keystone.service[81426]: *** uWSGI is running in multiple interpreter mode *** Oct 10 16:45:08.584456 dv-cinder-834540-2-smb devstack@keystone.service[81426]: spawned uWSGI master process (pid: 81426) Oct 10 16:45:08.584641 dv-cinder-834540-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 10 16:45:08.586165 dv-cinder-834540-2-smb devstack@keystone.service[81426]: spawned uWSGI worker 1 (pid: 81438, cores: 1) Oct 10 16:45:08.586165 dv-cinder-834540-2-smb devstack@keystone.service[81426]: spawned uWSGI worker 2 (pid: 81439, cores: 1) Oct 10 16:45:08.586165 dv-cinder-834540-2-smb devstack@keystone.service[81426]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 16:45:12.877113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 16:45:12.877113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: from cryptography.utils import int_from_bytes Oct 10 16:45:12.877902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 16:45:12.877902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: from cryptography.utils import int_from_bytes Oct 10 16:45:12.878323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 16:45:12.878323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: from cryptography.utils import int_from_bytes Oct 10 16:45:12.878439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 16:45:12.878439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: from cryptography.utils import int_from_bytes Oct 10 16:45:12.928380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 16:45:12.928530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 16:45:12.928627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 16:45:12.928703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 16:45:12.928771 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] command line args: [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 16:45:12.928836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] command line args: [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 16:45:12.928996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 16:45:12.929096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 16:45:12.929170 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ================================================================================ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 16:45:12.929246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ================================================================================ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 16:45:12.929409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] admin_token = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.929487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] admin_token = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.929656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_dir = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.929736 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] config_dir = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.929842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.929920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.930021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_source = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.930100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] config_source = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.930202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] debug = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.930281 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] debug = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.930397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.930696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.930857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.930949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_config_append = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.931976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_config_append = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_dir = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_dir = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_file = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932843 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.932927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.933086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.933205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.933329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.933443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.933567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.933725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.933884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.934012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.934133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.934247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.934366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.934490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.934652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.934769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.934889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.935934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] publish_errors = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] publish_errors = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.936999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.937119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.937237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.937370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.937481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.937630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.937755 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.937870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.937983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] standard_threads = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.938154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] standard_threads = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.939102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.939231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.939346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.939346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.939571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.939686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_journal = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.939799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.939963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_json = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.940080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_journal = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.940212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_stderr = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.940355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_json = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.940469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_syslog = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.940581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_stderr = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.940581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_syslog = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.940806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.940919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 16:45:12.941036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.941157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.941272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.941396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.941509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.941627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.941745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.941857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.941969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.942092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.942211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.942324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.942443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.942567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.942681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.942805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.942920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943261 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943840 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.943959 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.944080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.944205 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.944326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.944439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.944563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.944677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.944796 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.944919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.945033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.945145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.945257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.945375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.945488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.945677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.945792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.945904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946359 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.946993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.947107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.947218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.947336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.947448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.947559 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.947680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.947794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.947905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.948930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.949937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950165 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950646 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.950990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.951185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.951301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.951419 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.951537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.951650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.951768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.951890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.952924 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953146 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.953963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954828 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.954953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.955935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.956102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.956176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.956375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.956473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.956605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.956673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.956846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.956967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957186 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.957968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.958075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.958203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.958309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.958448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.958600 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.958720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.958835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.958938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.959989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.960102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.960255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.960372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.960475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.960595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.960710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.960813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.960931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.961052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.961155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.961348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.961469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.961577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.961690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.961813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.961925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.962989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.963103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.963223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.963339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.963453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.963575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.963690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.963803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.963917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.964030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.964144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.964265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.964383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.964497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.964612 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.964731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.964875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.external = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965243 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.external = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965359 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.password = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.965964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.966081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.token = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.966196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.password = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.966310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.966424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.token = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.966561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.966690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.966808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.966922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.967954 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.968081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.968202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.968318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.968432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.968546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.968661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.968783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.968899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.969991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.970116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.970116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.970334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.970449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.970606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.970736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.970862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.970979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.971094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.971209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.971324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.971442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.971566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.971683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.971799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.971913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972034 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972862 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.972984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.973101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.973216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.973331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.973445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.973571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.973689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.973804 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.973918 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.974033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.974033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.974255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.974372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.974485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.974625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.974743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.974859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975522 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975637 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.975992 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.976107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.976221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.976335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.976457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.976574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.976688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.976811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.976927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.977977 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.978082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.978196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.978310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.978424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.978624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.978743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.978858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.978973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.979988 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.980929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.981982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.982198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.982312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.982426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.982566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.982684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.982799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.982913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.983948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.984064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.984178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.984293 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.984407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.984522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.984522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.984747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.984862 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.985458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.985572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.985694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.985810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.985930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.986151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.986270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.986368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.986561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.986672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.986814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.986920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.987072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.987194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.987317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.987435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.987551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.987665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.987780 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.987894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.988944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.989985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.990108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.990224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.990340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.990454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.990583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.990700 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.990827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.990945 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991294 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.991997 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.992111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.992233 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.992349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.992464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.992578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.992694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.992808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.992931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.993973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.994088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.994202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.994325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.994441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.994610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.994728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.994845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.994960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.995083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.995199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.995314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.995429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.995543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.995658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.995811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.995956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.996074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.996188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.996303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.996417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.996541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.996656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.996771 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.996887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.997001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.997115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.997241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.997358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.997472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.997587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.997701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.997815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.998952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.999068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.999183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.999305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] role.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.999421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.999537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] role.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.999651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.999765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:12.999879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.000006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.000124 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.000238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.000353 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.000469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.001163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.001296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.001675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.001793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.001793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.002960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.003077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.003193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.003309 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.003424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.003539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.003662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.003778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.003892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004007 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004478 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.004944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005521 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005643 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.005986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.006101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.006215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.006338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.006454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.006616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.006735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.006880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007849 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.007965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.008080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.008194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.008308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.008422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.008544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.008660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.008774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.008888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.009936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.010062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.010186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.010303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.010418 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.010577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.010695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.010822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.010939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011636 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011755 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.011984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.012107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.012231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.012347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.012470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.012587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.012702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.012823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.012939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013293 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.013990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.014940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 16:45:13.015154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.015154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.015379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.015492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.015659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.015909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.016164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.016413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.016653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 16:45:13.016829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 16:45:13.044150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.044376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.044599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.044811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.045047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.045277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.053485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.054241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.081846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.082063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.082539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.082787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.135772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.136261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.185136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.185331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.185423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.185568 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.340722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.340950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.341174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.341397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.341615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.341834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.341919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.342136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.342364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.342609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.342826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.343041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.364797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.364905 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.365926 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.366050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.366133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.366260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.378050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.378493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.390611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.390838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.390927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.391064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.391758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.391974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.392136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.392202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.392264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.392337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.392462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.392545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.392621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.392761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 16:45:13.409130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.409343 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 16:45:13.409691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.409857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.409943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 16:45:13.410068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 16:45:13.410167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.410410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.410494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.410643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 16:45:13.410727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.410920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.411003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.411179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.411436 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.411691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.420475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.420761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.421040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.421123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.421332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.421416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.421632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.421916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.428312 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.428864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.431222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.431515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.431735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.431818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.432021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.432105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.432307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.432402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.432592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.432676 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.432866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.433148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.433242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.433426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.433507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.433704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.433784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.433976 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.434058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.434245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.434539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.434808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.457429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.458831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.458925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.459184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.460302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.460589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.463818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.464109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.464400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.465241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.465524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.465807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.470734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.471026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.472294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.472581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.476608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.476911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.477208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.477505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.477793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.478077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.478168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.478355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.478438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.478653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.478738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.478996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.479281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.479564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.479845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.480115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.493938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.494223 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.495404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.495684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.498021 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.499545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.501969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.502269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.503627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.503926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.506411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.508019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.509474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.511073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.512626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.512934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.513225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.513517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.513802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.514091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.514173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.514471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.514783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.515070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.515349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.515631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.530140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.530433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.530729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.531000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.531952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.532252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.532522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.532790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.537927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.539508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.539602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.541023 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.541159 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.541305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.542652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.542941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.544048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.544348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.544646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.544938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.545333 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.545656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.545942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.546226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.546511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.546928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.556511 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.556803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.557094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.557382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.557768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.557906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.558062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.558190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.558350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.558474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.558784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.559164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.559441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.559721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.574059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.575647 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.576969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.578497 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.579938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.581439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.581546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.582926 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.583053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.583216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.583625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.584554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.584836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.585239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.589933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.591402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.591530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.592965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.594834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.595401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.595706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.596009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.596423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.596817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.597107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.597387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.603778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.604077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.604364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.605099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.605390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.605671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.611913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.612199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.612485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.612770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.613063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.613145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 16:45:13.613344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.613429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.613625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.613711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.613901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.614000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.614180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.614273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.614454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.614570 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.614756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.614853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.615040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.615121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.615310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.615390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.615593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.615674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.615874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.616147 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.616415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.616692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 16:45:13.649463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5610bcd559c0 pid: 81439 (default app) Oct 10 16:45:13.650405 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5610bcd559c0 pid: 81438 (default app) Oct 10 16:45:13.652697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041ec7-a519-42cc-92cb-9b5a628be96c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:13.652991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041ec7-a519-42cc-92cb-9b5a628be96c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:13.653270 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041ec7-a519-42cc-92cb-9b5a628be96c None None] PATH_INFO: `/v3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:13.658040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Mon Oct 10 16:45:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:20.422315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d2a5-d718-4cce-802e-76bfc848e2c1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:20.422861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d2a5-d718-4cce-802e-76bfc848e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:20.422963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d2a5-d718-4cce-802e-76bfc848e2c1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:20.427831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:45:20.433092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:20.433525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:20.433664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:20.508132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: INFO dbcounter [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] Registered counter for database keystone Oct 10 16:45:20.527117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG oslo_db.sqlalchemy.engines [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:45:20.533466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writer thread running {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:45:20.716262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG passlib.handlers.bcrypt [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81439) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 10 16:45:20.716568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG passlib.handlers.bcrypt [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81439) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 10 16:45:20.774904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:20.776510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:20.904757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 10 16:45:21.329751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d2a5-d718-4cce-802e-76bfc848e2c1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:21.399729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: INFO dbcounter [None req-0272d2a5-d718-4cce-802e-76bfc848e2c1 None None] Registered counter for database keystone Oct 10 16:45:21.421055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG oslo_db.sqlalchemy.engines [None req-0272d2a5-d718-4cce-802e-76bfc848e2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 16:45:21.427702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writer thread running {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 16:45:21.546015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d2a5-d718-4cce-802e-76bfc848e2c1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:21.550353 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e7299-14ab-45cf-b851-3fc9834635c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:21.551003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e7299-14ab-45cf-b851-3fc9834635c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:21.551286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e7299-14ab-45cf-b851-3fc9834635c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:21.551557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e7299-14ab-45cf-b851-3fc9834635c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:21.559630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e7299-14ab-45cf-b851-3fc9834635c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:21.612861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e03e7299-14ab-45cf-b851-3fc9834635c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 10 16:45:21.613135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e7299-14ab-45cf-b851-3fc9834635c1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:21.622274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Oct 10 16:45:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 16:45:21.628454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:21.645038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4255f2-008a-4137-a7c6-b87c4de79ca5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:21.649453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d36bf4-ae7e-4d06-a341-895b0df26a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:21.650559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d36bf4-ae7e-4d06-a341-895b0df26a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:21.650844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d36bf4-ae7e-4d06-a341-895b0df26a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:21.651117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d36bf4-ae7e-4d06-a341-895b0df26a72 admin admin] PATH_INFO: `/v3/projects/900946e9f4af4713b0f50c103f092bc1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:21.652684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d36bf4-ae7e-4d06-a341-895b0df26a72 admin admin] RBAC: Authorizing `identity:get_project(project_id=900946e9f4af4713b0f50c103f092bc1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:21.706361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e2d36bf4-ae7e-4d06-a341-895b0df26a72 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 10 16:45:21.706728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d36bf4-ae7e-4d06-a341-895b0df26a72 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:21.711180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Oct 10 16:45:21 2022] GET /identity/v3/projects/900946e9f4af4713b0f50c103f092bc1 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:23.812258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6e4e-adde-4f19-a795-af403f3ac371 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:23.812798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6e4e-adde-4f19-a795-af403f3ac371 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:23.812798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6e4e-adde-4f19-a795-af403f3ac371 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:23.817518 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:23.822914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c230-36c8-4378-bea6-1c587f14d1e3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:23.823330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c230-36c8-4378-bea6-1c587f14d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:23.823476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c230-36c8-4378-bea6-1c587f14d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:23.843576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c632c230-36c8-4378-bea6-1c587f14d1e3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:23.845079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c632c230-36c8-4378-bea6-1c587f14d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:23.853274 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 10 16:45:24.123785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d6e4e-adde-4f19-a795-af403f3ac371 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:24.136090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d6e4e-adde-4f19-a795-af403f3ac371 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:24.140199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb0537-0235-4393-ba98-dacead942fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:24.140804 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0537-0235-4393-ba98-dacead942fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:24.141080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0537-0235-4393-ba98-dacead942fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:24.141350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0537-0235-4393-ba98-dacead942fe7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:24.149434 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb0537-0235-4393-ba98-dacead942fe7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:24.151228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb0537-0235-4393-ba98-dacead942fe7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:24.160506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Oct 10 16:45:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 16:45:24.165714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c230-36c8-4378-bea6-1c587f14d1e3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:24.174642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c230-36c8-4378-bea6-1c587f14d1e3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:24.178907 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f2f9a-81ce-4d96-8562-5e67f24b153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:24.179520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f2f9a-81ce-4d96-8562-5e67f24b153f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:24.179800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f2f9a-81ce-4d96-8562-5e67f24b153f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:24.180075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f2f9a-81ce-4d96-8562-5e67f24b153f admin admin] PATH_INFO: `/v3/users/7e37cdb10c97478cae45037ee23ff133` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:24.181364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f2f9a-81ce-4d96-8562-5e67f24b153f admin admin] RBAC: Authorizing `identity:get_user(user_id=7e37cdb10c97478cae45037ee23ff133)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:24.183218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f2f9a-81ce-4d96-8562-5e67f24b153f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:24.184710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Mon Oct 10 16:45:24 2022] GET /identity/v3/users/7e37cdb10c97478cae45037ee23ff133 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:26.350883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8b12-b4b0-4c46-851d-b588733b1bce None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:26.351387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8b12-b4b0-4c46-851d-b588733b1bce None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:26.351387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8b12-b4b0-4c46-851d-b588733b1bce None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:26.352662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:26.357720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f48ea-fdc6-43ef-944f-32ea0d7f70b4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:26.358104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f48ea-fdc6-43ef-944f-32ea0d7f70b4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:26.358403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f48ea-fdc6-43ef-944f-32ea0d7f70b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:26.377412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2c9f48ea-fdc6-43ef-944f-32ea0d7f70b4 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:26.378606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2c9f48ea-fdc6-43ef-944f-32ea0d7f70b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:26.423830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a339-08ea-4bc6-82de-06a2eefaa43e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:26.424113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a339-08ea-4bc6-82de-06a2eefaa43e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:26.424388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a339-08ea-4bc6-82de-06a2eefaa43e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:26.425712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:45:26.430874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:26.431156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:26.431427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:26.461543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:45:26.474921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG passlib.handlers.bcrypt [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81438) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 10 16:45:26.475309 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG passlib.handlers.bcrypt [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81438) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 10 16:45:26.524363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:26.525911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:26.623669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:45:26.727296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f48ea-fdc6-43ef-944f-32ea0d7f70b4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:26.750257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:26.831307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f48ea-fdc6-43ef-944f-32ea0d7f70b4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:26.863764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705219-c3f8-412e-8c3d-a8cbfd7f9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:26.864404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705219-c3f8-412e-8c3d-a8cbfd7f9327 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:26.864691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705219-c3f8-412e-8c3d-a8cbfd7f9327 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:26.864989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705219-c3f8-412e-8c3d-a8cbfd7f9327 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:26.875930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25705219-c3f8-412e-8c3d-a8cbfd7f9327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-25705219-c3f8-412e-8c3d-a8cbfd7f9327 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:26.886011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:26.886978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:26.887774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:26.891806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:26.893406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705219-c3f8-412e-8c3d-a8cbfd7f9327 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:26.972660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:26.990172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705219-c3f8-412e-8c3d-a8cbfd7f9327 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:26.992463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9f0f3-8c70-4520-9f26-84c4dd8a4b52 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:26.994750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:27.025113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:27.025721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:27.026014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:27.026311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:27.027013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:27.027318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:27.028712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:27.031329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:27.032188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:27.032469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:27.032744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:27.033748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:27.035177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:27.040440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:27.046303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.sql.core [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 10 16:45:27.046303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 16:45:27.046303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [parameters: {'id': 'dcb4e4a9d96e4ab9839e273f05101112', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 10 16:45:27.046303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 16:45:27.046730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:45:27.065204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 10 16:45:27.066219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application yield resource Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise self.value Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application session.commit() Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 16:45:27.067376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.flush() Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application compat.raise_( Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 16:45:27.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 16:45:27.069529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:45:27.070435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [parameters: {'id': 'dcb4e4a9d96e4ab9839e273f05101112', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 10 16:45:27.071467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:27.072367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:27.073478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 8/16] 10.222.0.27 () {60 vars in 1137 bytes} [Mon Oct 10 16:45:26 2022] POST /identity/v3/domains => generated 190 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:27.081139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:27.156635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c37d9e-d17d-466c-ae87-bc4afe7326ec None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:27.181655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e49ce-8b76-4bab-bc32-39127913bfdc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:27.190649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a1bfa-6ebf-4866-9d27-368a5cf6c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:27.191278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1bfa-6ebf-4866-9d27-368a5cf6c370 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:27.191556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1bfa-6ebf-4866-9d27-368a5cf6c370 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:27.191829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1bfa-6ebf-4866-9d27-368a5cf6c370 None admin] PATH_INFO: `/v3/users/7e37cdb10c97478cae45037ee23ff133` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:27.192962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a1bfa-6ebf-4866-9d27-368a5cf6c370 None admin] RBAC: Authorizing `identity:get_user(user_id=7e37cdb10c97478cae45037ee23ff133)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:27.194418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a1bfa-6ebf-4866-9d27-368a5cf6c370 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:27.196248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:27 2022] GET /identity/v3/users/7e37cdb10c97478cae45037ee23ff133 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:27.201394 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a1bfa-6ebf-4866-9d27-368a5cf6c370 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:27.215734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:27.215906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:27.216828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:27.217067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:27.217367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:27.235571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:27.237605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:45:27.254053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:27.254974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:45:27.255899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:45:27.255899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:45:27.255899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:27.255899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:45:27.260883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:27.284539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:27.301931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a1bfa-6ebf-4866-9d27-368a5cf6c370 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:27.336339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa894fa-3ceb-4f7a-8c5e-ce6ee734f2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:27.336956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa894fa-3ceb-4f7a-8c5e-ce6ee734f2ef None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:27.337233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa894fa-3ceb-4f7a-8c5e-ce6ee734f2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:27.337502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa894fa-3ceb-4f7a-8c5e-ce6ee734f2ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:27.338626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa894fa-3ceb-4f7a-8c5e-ce6ee734f2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:27.340062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa894fa-3ceb-4f7a-8c5e-ce6ee734f2ef None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:27.341581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:27.347589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa894fa-3ceb-4f7a-8c5e-ce6ee734f2ef None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:27.363105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05dc97-c2cb-44b0-8393-9b9a075ab59f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:27.400167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea737c-27e2-42fa-8bae-519274b31824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:27.400772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea737c-27e2-42fa-8bae-519274b31824 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:27.401085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea737c-27e2-42fa-8bae-519274b31824 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:27.401334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea737c-27e2-42fa-8bae-519274b31824 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:27.401973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea737c-27e2-42fa-8bae-519274b31824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:27.402276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea737c-27e2-42fa-8bae-519274b31824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:27.403672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea737c-27e2-42fa-8bae-519274b31824 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:27.420955 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:27.426334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:27.446814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa894fa-3ceb-4f7a-8c5e-ce6ee734f2ef None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:27.483641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b62b0-0cd8-42cc-a22f-4643d92a1f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:27.484330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b62b0-0cd8-42cc-a22f-4643d92a1f0c None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:27.484613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b62b0-0cd8-42cc-a22f-4643d92a1f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:27.484896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b62b0-0cd8-42cc-a22f-4643d92a1f0c None admin] PATH_INFO: `/v3/domains/default/users/7e37cdb10c97478cae45037ee23ff133/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:27.487444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b62b0-0cd8-42cc-a22f-4643d92a1f0c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7e37cdb10c97478cae45037ee23ff133, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:27.488914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b62b0-0cd8-42cc-a22f-4643d92a1f0c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:27.608565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 11/21] 10.222.0.27 () {58 vars in 1361 bytes} [Mon Oct 10 16:45:27 2022] PUT /identity/v3/domains/default/users/7e37cdb10c97478cae45037ee23ff133/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:45:29.963885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996fff-fd4b-4c97-8407-5f57af07cf14 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:29.964409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996fff-fd4b-4c97-8407-5f57af07cf14 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:29.964409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996fff-fd4b-4c97-8407-5f57af07cf14 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:29.965745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:29.973120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a7ea1-8e12-4771-9fbe-1e62dcf5e2c3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:29.973540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a7ea1-8e12-4771-9fbe-1e62dcf5e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:29.973688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a7ea1-8e12-4771-9fbe-1e62dcf5e2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:30.003702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-800a7ea1-8e12-4771-9fbe-1e62dcf5e2c3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:30.005615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-800a7ea1-8e12-4771-9fbe-1e62dcf5e2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:30.094449 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:30.386224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64786b-970e-4011-8058-8d6d53018aaa None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:30.386554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64786b-970e-4011-8058-8d6d53018aaa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:30.386719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64786b-970e-4011-8058-8d6d53018aaa None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:30.388214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:30.403834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16211d1-4aaa-4f19-b988-8f078828ba04 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:30.404388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16211d1-4aaa-4f19-b988-8f078828ba04 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:30.404872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16211d1-4aaa-4f19-b988-8f078828ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:30.434139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a16211d1-4aaa-4f19-b988-8f078828ba04 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:30.435750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a16211d1-4aaa-4f19-b988-8f078828ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:30.516732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:30.522902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:30.641802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3d7a7-b329-474f-9c66-817ecbace5a4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:30.642107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3d7a7-b329-474f-9c66-817ecbace5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:30.642396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3d7a7-b329-474f-9c66-817ecbace5a4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:30.643916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 13/26] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:30.649380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c124a7-0073-4e63-92d1-e0c3423f2004 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:30.649893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c124a7-0073-4e63-92d1-e0c3423f2004 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:30.650363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c124a7-0073-4e63-92d1-e0c3423f2004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:30.659530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6e22f-3935-47da-8644-8fe1dcceefe9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:30.659812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6e22f-3935-47da-8644-8fe1dcceefe9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:30.660089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6e22f-3935-47da-8644-8fe1dcceefe9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:30.661760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:30.662544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6e22f-3935-47da-8644-8fe1dcceefe9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:30.678064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-83c124a7-0073-4e63-92d1-e0c3423f2004 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:30.679309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-83c124a7-0073-4e63-92d1-e0c3423f2004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:30.788726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:30.793039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 14/28] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:45:30.794244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa865-dadf-4675-bb7c-1a49d44f38f3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:30.794677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa865-dadf-4675-bb7c-1a49d44f38f3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:30.794906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa865-dadf-4675-bb7c-1a49d44f38f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:30.823626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6e22f-3935-47da-8644-8fe1dcceefe9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:30.826118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b93fa865-dadf-4675-bb7c-1a49d44f38f3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:30.831791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b93fa865-dadf-4675-bb7c-1a49d44f38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:30.887580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:30.888466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:30.888800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:30.891913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:30.912619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:30.914235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:45:30.944136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:30.945030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:45:30.945848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:45:30.945848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:45:30.945848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:30.945848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 15/29] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:30.950686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:30.962266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 15/30] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:30.965045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa865-dadf-4675-bb7c-1a49d44f38f3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:31.074002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:31.150187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa865-dadf-4675-bb7c-1a49d44f38f3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:31.154015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580242f6-0dd3-4219-900a-070e68b8b2e4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:31.213427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:31.223162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:31.223787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.224111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.224332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.224992 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:31.225295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:31.226922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:31.229403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c02ce-6228-4d7c-b4ff-364d58e7b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:31.230023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c02ce-6228-4d7c-b4ff-364d58e7b997 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.230298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c02ce-6228-4d7c-b4ff-364d58e7b997 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.230587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c02ce-6228-4d7c-b4ff-364d58e7b997 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.231271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c02ce-6228-4d7c-b4ff-364d58e7b997 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:31.232708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c02ce-6228-4d7c-b4ff-364d58e7b997 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:31.259746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 16/31] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:31.264496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:31.376978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 16/32] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Oct 10 16:45:30 2022] POST /identity/v3/roles => generated 219 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:31.378587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c02ce-6228-4d7c-b4ff-364d58e7b997 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:31.382685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feacedc-86d1-4265-8f13-1d64943a85e8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:31.408469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:31.425342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa019eb-bb2a-418b-a115-a6b513067f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:31.426005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa019eb-bb2a-418b-a115-a6b513067f27 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.426281 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa019eb-bb2a-418b-a115-a6b513067f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.426577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa019eb-bb2a-418b-a115-a6b513067f27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.438551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa019eb-bb2a-418b-a115-a6b513067f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-1fa019eb-bb2a-418b-a115-a6b513067f27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:31.444241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:31.445917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:31.452480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672668-23c0-4cde-a32f-4d84b662bee1 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.452480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672668-23c0-4cde-a32f-4d84b662bee1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.452480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672668-23c0-4cde-a32f-4d84b662bee1 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.452480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 18/34] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:31.452480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672668-23c0-4cde-a32f-4d84b662bee1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:31.530562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c02ce-6228-4d7c-b4ff-364d58e7b997 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:31.577194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672668-23c0-4cde-a32f-4d84b662bee1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:31.577489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548502ba-4f05-4e21-b997-c82627664f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:31.578103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548502ba-4f05-4e21-b997-c82627664f3e None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.578384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548502ba-4f05-4e21-b997-c82627664f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.578781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548502ba-4f05-4e21-b997-c82627664f3e None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.579409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548502ba-4f05-4e21-b997-c82627664f3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:31.581562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548502ba-4f05-4e21-b997-c82627664f3e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:31.616643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 17/35] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:45:31 2022] POST /identity/v3/projects => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:31.617331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548502ba-4f05-4e21-b997-c82627664f3e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:31.631372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d66b6c-edc8-41b7-b830-1bcfe5ebe656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:31.632021 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d66b6c-edc8-41b7-b830-1bcfe5ebe656 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.632286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d66b6c-edc8-41b7-b830-1bcfe5ebe656 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.632716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d66b6c-edc8-41b7-b830-1bcfe5ebe656 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.633476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d66b6c-edc8-41b7-b830-1bcfe5ebe656 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:31.634684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d66b6c-edc8-41b7-b830-1bcfe5ebe656 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:31.674683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 19/36] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Oct 10 16:45:31 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:31.675851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97199d7-0022-431b-9140-da842acdf776 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.675851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97199d7-0022-431b-9140-da842acdf776 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.676094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97199d7-0022-431b-9140-da842acdf776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.680377 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:31.722841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f97199d7-0022-431b-9140-da842acdf776 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:31.724085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f97199d7-0022-431b-9140-da842acdf776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:31.781024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548502ba-4f05-4e21-b997-c82627664f3e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:31.811173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:31.869686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e67c9-8e35-47d7-84f4-891542b00991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:31.870324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e67c9-8e35-47d7-84f4-891542b00991 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.870628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e67c9-8e35-47d7-84f4-891542b00991 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.870999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e67c9-8e35-47d7-84f4-891542b00991 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.871714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e67c9-8e35-47d7-84f4-891542b00991 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:31.872024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e67c9-8e35-47d7-84f4-891542b00991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:31.873522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e67c9-8e35-47d7-84f4-891542b00991 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:31.902789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 18/37] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:31.904621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3d7b-4495-4054-afff-399bcf0fbbdb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:31.905142 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3d7b-4495-4054-afff-399bcf0fbbdb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:31.905630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3d7b-4495-4054-afff-399bcf0fbbdb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:31.909547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 19/38] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:31.910814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de3d7b-4495-4054-afff-399bcf0fbbdb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:32.006707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 20/39] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:32.007888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9071f3-9739-4053-9c98-bda8d7af1623 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:32.008178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9071f3-9739-4053-9c98-bda8d7af1623 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:32.008450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9071f3-9739-4053-9c98-bda8d7af1623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:32.026361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1a9071f3-9739-4053-9c98-bda8d7af1623 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:32.027585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a9071f3-9739-4053-9c98-bda8d7af1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:32.046539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de3d7b-4495-4054-afff-399bcf0fbbdb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:32.056363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:32.090865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d59ca2-a880-4b31-b79f-526aeaddd682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:32.091808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d59ca2-a880-4b31-b79f-526aeaddd682 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:32.092108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d59ca2-a880-4b31-b79f-526aeaddd682 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:32.092388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d59ca2-a880-4b31-b79f-526aeaddd682 None admin] PATH_INFO: `/v3/users/7e37cdb10c97478cae45037ee23ff133` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:32.093823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d59ca2-a880-4b31-b79f-526aeaddd682 None admin] RBAC: Authorizing `identity:get_user(user_id=7e37cdb10c97478cae45037ee23ff133)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:32.095343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d59ca2-a880-4b31-b79f-526aeaddd682 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:32.096751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:32.097207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 20/41] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:31 2022] GET /identity/v3/users/7e37cdb10c97478cae45037ee23ff133 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:32.102655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d59ca2-a880-4b31-b79f-526aeaddd682 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:32.207570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d59ca2-a880-4b31-b79f-526aeaddd682 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:32.240988 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b252e-06d2-4160-8bc7-4acff52d9120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:32.241612 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b252e-06d2-4160-8bc7-4acff52d9120 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:32.241895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b252e-06d2-4160-8bc7-4acff52d9120 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:32.242172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b252e-06d2-4160-8bc7-4acff52d9120 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:32.243324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b252e-06d2-4160-8bc7-4acff52d9120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:32.244845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b252e-06d2-4160-8bc7-4acff52d9120 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:32.246639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 21/42] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:32.252810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9071f3-9739-4053-9c98-bda8d7af1623 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:32.272944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b252e-06d2-4160-8bc7-4acff52d9120 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:32.320147 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:32.356995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:32.359866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9071f3-9739-4053-9c98-bda8d7af1623 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:32.387514 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b252e-06d2-4160-8bc7-4acff52d9120 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:32.396269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:32.396886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:32.397179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:32.397449 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:32.398178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.domain.id=default, user.id=7e37cdb10c97478cae45037ee23ff133) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:32.398487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:32.399963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:32.407033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 22/43] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Oct 10 16:45:32 2022] GET /identity/v3/role_assignments?user.id=7e37cdb10c97478cae45037ee23ff133&scope.domain.id=default&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:32.407854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:32.426161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69172f0-62c9-4d1d-90db-6cebad42301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:32.426846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69172f0-62c9-4d1d-90db-6cebad42301f None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:32.427135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69172f0-62c9-4d1d-90db-6cebad42301f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:32.427876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69172f0-62c9-4d1d-90db-6cebad42301f None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:32.428622 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69172f0-62c9-4d1d-90db-6cebad42301f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:32.430433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69172f0-62c9-4d1d-90db-6cebad42301f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:32.448613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Oct 10 16:45:32 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:45:32.550194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a78481-1026-4fbd-845b-b718d7b6eacd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:32.591993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f67fe-84e1-4c62-892a-38895d75887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:32.592950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f67fe-84e1-4c62-892a-38895d75887f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:32.593437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f67fe-84e1-4c62-892a-38895d75887f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:32.593888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f67fe-84e1-4c62-892a-38895d75887f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:32.595971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f67fe-84e1-4c62-892a-38895d75887f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:32.598205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f67fe-84e1-4c62-892a-38895d75887f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:32.600146 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 23/45] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:32.606775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69172f0-62c9-4d1d-90db-6cebad42301f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:32.716927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69172f0-62c9-4d1d-90db-6cebad42301f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:32.718439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:32.752002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80a7fe-b815-4422-99f3-613fcfb1bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:32.752619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a7fe-b815-4422-99f3-613fcfb1bbdb None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:32.752903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a7fe-b815-4422-99f3-613fcfb1bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:32.753180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a7fe-b815-4422-99f3-613fcfb1bbdb None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:32.753831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80a7fe-b815-4422-99f3-613fcfb1bbdb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:32.755290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80a7fe-b815-4422-99f3-613fcfb1bbdb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:32.781515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:45:32 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:34.933543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6b7b-dc59-49c4-9a5e-8a574e4b687d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:34.933975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6b7b-dc59-49c4-9a5e-8a574e4b687d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:34.934106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6b7b-dc59-49c4-9a5e-8a574e4b687d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:34.935501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:34.940734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820979fb-1fc8-418a-af66-162ea5d5d109 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:34.941132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820979fb-1fc8-418a-af66-162ea5d5d109 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:34.941297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820979fb-1fc8-418a-af66-162ea5d5d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:34.959861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-820979fb-1fc8-418a-af66-162ea5d5d109 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:34.961384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-820979fb-1fc8-418a-af66-162ea5d5d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:35.026809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:35.294104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c6b7b-dc59-49c4-9a5e-8a574e4b687d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:35.324478 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:35.393326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c6b7b-dc59-49c4-9a5e-8a574e4b687d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:35.425957 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9658da0-5135-4846-94ca-3d624f237e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:35.426595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658da0-5135-4846-94ca-3d624f237e0a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:35.426881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658da0-5135-4846-94ca-3d624f237e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:35.427159 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658da0-5135-4846-94ca-3d624f237e0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:35.428265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9658da0-5135-4846-94ca-3d624f237e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:35.429724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9658da0-5135-4846-94ca-3d624f237e0a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:35.431299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 25/49] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:35.436902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820979fb-1fc8-418a-af66-162ea5d5d109 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:35.522701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:35.539134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820979fb-1fc8-418a-af66-162ea5d5d109 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:35.573277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081454e-6b26-4d6e-ae3f-e444674f9ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:35.573824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081454e-6b26-4d6e-ae3f-e444674f9ac7 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:35.574106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081454e-6b26-4d6e-ae3f-e444674f9ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:35.574379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081454e-6b26-4d6e-ae3f-e444674f9ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:35.575066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081454e-6b26-4d6e-ae3f-e444674f9ac7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:35.576497 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081454e-6b26-4d6e-ae3f-e444674f9ac7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:35.601702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 25/50] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Oct 10 16:45:35 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:45:37.739807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558bcfe-c477-4cf9-b8b7-8db3d067f111 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:37.740327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558bcfe-c477-4cf9-b8b7-8db3d067f111 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:37.740411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558bcfe-c477-4cf9-b8b7-8db3d067f111 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:37.741717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 26/51] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:37.746789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e8d3-c315-44af-b985-aab72579b197 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:37.747199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e8d3-c315-44af-b985-aab72579b197 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:37.747345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e8d3-c315-44af-b985-aab72579b197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:37.765318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d4b2e8d3-c315-44af-b985-aab72579b197 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:37.766488 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4b2e8d3-c315-44af-b985-aab72579b197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:37.832638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 26/52] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:38.101507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558bcfe-c477-4cf9-b8b7-8db3d067f111 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:38.196908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:38.201067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558bcfe-c477-4cf9-b8b7-8db3d067f111 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:38.234696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534af882-8e8c-46b0-b4af-6a36b1ab6847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:38.235326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af882-8e8c-46b0-b4af-6a36b1ab6847 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:38.235611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af882-8e8c-46b0-b4af-6a36b1ab6847 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:38.236549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af882-8e8c-46b0-b4af-6a36b1ab6847 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:38.237706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af882-8e8c-46b0-b4af-6a36b1ab6847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:38.239189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af882-8e8c-46b0-b4af-6a36b1ab6847 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:38.240765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:38.246322 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e8d3-c315-44af-b985-aab72579b197 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:38.311805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:38.347687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e8d3-c315-44af-b985-aab72579b197 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:38.380316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ce90b-aa46-4f33-add1-14c446d56ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:38.380866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ce90b-aa46-4f33-add1-14c446d56ffd None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:38.381148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ce90b-aa46-4f33-add1-14c446d56ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:38.381422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ce90b-aa46-4f33-add1-14c446d56ffd None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:38.382069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ce90b-aa46-4f33-add1-14c446d56ffd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:38.383549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ce90b-aa46-4f33-add1-14c446d56ffd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:38.411298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 27/54] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:45:38 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:41.710448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9a8d4-1c0c-47ce-8de7-862d49afb7ec None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:41.710448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9a8d4-1c0c-47ce-8de7-862d49afb7ec None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:41.710448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9a8d4-1c0c-47ce-8de7-862d49afb7ec None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:41.711451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 28/55] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:41.715773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd37c-d603-445f-b224-aebd2ac27b6a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:41.716487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd37c-d603-445f-b224-aebd2ac27b6a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:41.716923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd37c-d603-445f-b224-aebd2ac27b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:41.865998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bb2dd37c-d603-445f-b224-aebd2ac27b6a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:41.867475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bb2dd37c-d603-445f-b224-aebd2ac27b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:41.884441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87ffb-0a86-4d30-bc58-301ed3cad73d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:41.884954 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87ffb-0a86-4d30-bc58-301ed3cad73d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:41.885396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87ffb-0a86-4d30-bc58-301ed3cad73d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:41.887064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 29/56] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:45:41.897485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3341-32bb-4d65-9312-2915e7c2c257 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:41.897775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3341-32bb-4d65-9312-2915e7c2c257 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:41.898036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3341-32bb-4d65-9312-2915e7c2c257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:41.927598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9eee3341-32bb-4d65-9312-2915e7c2c257 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:41.928824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9eee3341-32bb-4d65-9312-2915e7c2c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:41.985130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 28/57] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:41.987904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0544b-2f46-4684-a78e-97d544847eb2 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:41.988463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0544b-2f46-4684-a78e-97d544847eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:41.988963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0544b-2f46-4684-a78e-97d544847eb2 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:41.991002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 29/58] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:41.997610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a81b-1f23-466b-a227-980bc4268495 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:41.998427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a81b-1f23-466b-a227-980bc4268495 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:41.999628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a81b-1f23-466b-a227-980bc4268495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.035535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8ae9a81b-1f23-466b-a227-980bc4268495 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:42.037235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8ae9a81b-1f23-466b-a227-980bc4268495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:42.074603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 30/59] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:42.127652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:42.155970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 30/60] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:42.176428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232e424-ab31-438f-b4bc-df996c515b98 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.176721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232e424-ab31-438f-b4bc-df996c515b98 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.176997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232e424-ab31-438f-b4bc-df996c515b98 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.178530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 31/61] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:42.183498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177adda-5efa-406b-878b-d911ce2ea796 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.183785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177adda-5efa-406b-878b-d911ce2ea796 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.184064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177adda-5efa-406b-878b-d911ce2ea796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.210799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6177adda-5efa-406b-878b-d911ce2ea796 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:42.212490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6177adda-5efa-406b-878b-d911ce2ea796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:42.264092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232e424-ab31-438f-b4bc-df996c515b98 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:42.304912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 31/62] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:42.380648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177adda-5efa-406b-878b-d911ce2ea796 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:42.445256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:42.451165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232e424-ab31-438f-b4bc-df996c515b98 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:42.511340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfacae5-445a-4afa-af9b-2d5092eff0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:42.512693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfacae5-445a-4afa-af9b-2d5092eff0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.513400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfacae5-445a-4afa-af9b-2d5092eff0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.514339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfacae5-445a-4afa-af9b-2d5092eff0a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.522616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177adda-5efa-406b-878b-d911ce2ea796 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:42.527139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfacae5-445a-4afa-af9b-2d5092eff0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6dfacae5-445a-4afa-af9b-2d5092eff0a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:42.532072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:42.533575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:42.534388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 32/63] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:45:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:42.535835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6d6a9-f209-4d91-ba1f-7f18af8b29cb None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.535835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6d6a9-f209-4d91-ba1f-7f18af8b29cb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.536130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6d6a9-f209-4d91-ba1f-7f18af8b29cb None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.537369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 33/64] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:42.538048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6d6a9-f209-4d91-ba1f-7f18af8b29cb None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:42.544084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:42.568538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7b6d6-8d57-443d-8b13-5abf443f907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:42.569180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7b6d6-8d57-443d-8b13-5abf443f907a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.569471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7b6d6-8d57-443d-8b13-5abf443f907a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.569751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7b6d6-8d57-443d-8b13-5abf443f907a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.581373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7b6d6-8d57-443d-8b13-5abf443f907a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1fb7b6d6-8d57-443d-8b13-5abf443f907a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:42.587805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:42.588627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:42.589448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 32/65] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:45:42.590057 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7b6d6-8d57-443d-8b13-5abf443f907a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:42.645583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6d6a9-f209-4d91-ba1f-7f18af8b29cb None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:42.682460 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906d252-6be0-4880-9d16-69e96a0ecc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:42.683122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d252-6be0-4880-9d16-69e96a0ecc3a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.683405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d252-6be0-4880-9d16-69e96a0ecc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.683678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d252-6be0-4880-9d16-69e96a0ecc3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.693615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906d252-6be0-4880-9d16-69e96a0ecc3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:42.696033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7b6d6-8d57-443d-8b13-5abf443f907a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e906d252-6be0-4880-9d16-69e96a0ecc3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:42.698498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:42.699463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:45:42.700211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:42.702656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 34/66] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:45:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:42.704085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0cee-8bce-40ac-b605-27d78d826bf6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.704559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0cee-8bce-40ac-b605-27d78d826bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.704779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0cee-8bce-40ac-b605-27d78d826bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.722798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-61af0cee-8bce-40ac-b605-27d78d826bf6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:42.724932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-61af0cee-8bce-40ac-b605-27d78d826bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:42.732480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:42.733092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.733368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.733641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.734306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:42.734638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:42.736736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:42.739227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:42.744809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 33/67] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:42.747814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:42.781639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:42.796375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 35/68] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:42.797296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af0cee-8bce-40ac-b605-27d78d826bf6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:42.852791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb5809-6788-485f-9f3f-805441264fce None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:42.889807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:42.890425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.890741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.891021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.891686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:42.892754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:42.894689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:42.904261 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:45:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:42.904999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:42.910005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af0cee-8bce-40ac-b605-27d78d826bf6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:42.949231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4571-2a75-4c5b-8c25-82f17c1cf937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:42.949867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4571-2a75-4c5b-8c25-82f17c1cf937 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:42.950161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4571-2a75-4c5b-8c25-82f17c1cf937 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:42.950442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4571-2a75-4c5b-8c25-82f17c1cf937 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:42.961426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4571-2a75-4c5b-8c25-82f17c1cf937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-cf1d4571-2a75-4c5b-8c25-82f17c1cf937 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:42.967262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:42.968123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:42.968872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 36/70] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:42.970103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4571-2a75-4c5b-8c25-82f17c1cf937 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:42.983086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.015100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.022787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b2388-252e-4bf5-bda1-73ecc3ee58d3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.057770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.058314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.058627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.058908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.059581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:43.060015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.061387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.069678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:45:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.070563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.083723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4571-2a75-4c5b-8c25-82f17c1cf937 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.117048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf8573-4cf2-4bd0-a569-db1f1ec2a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.117691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8573-4cf2-4bd0-a569-db1f1ec2a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.117972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8573-4cf2-4bd0-a569-db1f1ec2a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.118277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8573-4cf2-4bd0-a569-db1f1ec2a4c9 None admin] PATH_INFO: `/v3/users/7e37cdb10c97478cae45037ee23ff133` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.119454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf8573-4cf2-4bd0-a569-db1f1ec2a4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=7e37cdb10c97478cae45037ee23ff133)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.120914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf8573-4cf2-4bd0-a569-db1f1ec2a4c9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.122498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 37/72] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:42 2022] GET /identity/v3/users/7e37cdb10c97478cae45037ee23ff133 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.123275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf8573-4cf2-4bd0-a569-db1f1ec2a4c9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.169019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda135-d873-49eb-877c-068ce5ab3e54 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.202583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.203688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6ddf1-3b88-4ec0-8854-cb89321655d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.204422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6ddf1-3b88-4ec0-8854-cb89321655d3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.204976 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6ddf1-3b88-4ec0-8854-cb89321655d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.205228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6ddf1-3b88-4ec0-8854-cb89321655d3 None admin] PATH_INFO: `/v3/users/317d8f3194da47098daad34218067fb6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.220157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6ddf1-3b88-4ec0-8854-cb89321655d3 None admin] RBAC: Authorizing `identity:get_user(user_id=317d8f3194da47098daad34218067fb6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.221513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6ddf1-3b88-4ec0-8854-cb89321655d3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.223160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/users/317d8f3194da47098daad34218067fb6 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.223927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6ddf1-3b88-4ec0-8854-cb89321655d3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.229826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf8573-4cf2-4bd0-a569-db1f1ec2a4c9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.241500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.265022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.265635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.265921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.266200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.266945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:43.267251 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.268636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.276854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 38/74] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.277635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.326255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6ddf1-3b88-4ec0-8854-cb89321655d3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.360028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74a7d-9ab2-4571-89d8-96706f7ef5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.361399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74a7d-9ab2-4571-89d8-96706f7ef5ae None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.361683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74a7d-9ab2-4571-89d8-96706f7ef5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.361956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74a7d-9ab2-4571-89d8-96706f7ef5ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.363100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f74a7d-9ab2-4571-89d8-96706f7ef5ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.364533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f74a7d-9ab2-4571-89d8-96706f7ef5ae None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.366246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.366860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74a7d-9ab2-4571-89d8-96706f7ef5ae None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.378138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ca38-7999-41a9-bdb1-0ab1e1443792 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.411392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24401278-739f-48a0-93ed-a9e083862505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.412017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24401278-739f-48a0-93ed-a9e083862505 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.412298 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24401278-739f-48a0-93ed-a9e083862505 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.412572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24401278-739f-48a0-93ed-a9e083862505 None admin] PATH_INFO: `/v3/users/317d8f3194da47098daad34218067fb6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.413690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24401278-739f-48a0-93ed-a9e083862505 None admin] RBAC: Authorizing `identity:get_user(user_id=317d8f3194da47098daad34218067fb6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.415170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24401278-739f-48a0-93ed-a9e083862505 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.416723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 39/76] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/users/317d8f3194da47098daad34218067fb6 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.421285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24401278-739f-48a0-93ed-a9e083862505 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.426647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.452622 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.469946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74a7d-9ab2-4571-89d8-96706f7ef5ae None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.504311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20294f1-c7c4-48b5-9656-26177b7beaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.504938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20294f1-c7c4-48b5-9656-26177b7beaaf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.505219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20294f1-c7c4-48b5-9656-26177b7beaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.505501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20294f1-c7c4-48b5-9656-26177b7beaaf None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.506649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20294f1-c7c4-48b5-9656-26177b7beaaf None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.508100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20294f1-c7c4-48b5-9656-26177b7beaaf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.509916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 38/77] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.510465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20294f1-c7c4-48b5-9656-26177b7beaaf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.521837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24401278-739f-48a0-93ed-a9e083862505 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.554472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c1534-85cd-409e-8f98-7de34152333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.555137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c1534-85cd-409e-8f98-7de34152333f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.555425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c1534-85cd-409e-8f98-7de34152333f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.555704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c1534-85cd-409e-8f98-7de34152333f None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.556829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c1534-85cd-409e-8f98-7de34152333f None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.558278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c1534-85cd-409e-8f98-7de34152333f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.559945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 40/78] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.565897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c1534-85cd-409e-8f98-7de34152333f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.611675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20294f1-c7c4-48b5-9656-26177b7beaaf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.639207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.645632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec5be-fa09-45fd-9d86-c2e4f84ceb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.646435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec5be-fa09-45fd-9d86-c2e4f84ceb75 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.646752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec5be-fa09-45fd-9d86-c2e4f84ceb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.647398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec5be-fa09-45fd-9d86-c2e4f84ceb75 None admin] PATH_INFO: `/v3/users/317d8f3194da47098daad34218067fb6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.648683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ec5be-fa09-45fd-9d86-c2e4f84ceb75 None admin] RBAC: Authorizing `identity:get_user(user_id=317d8f3194da47098daad34218067fb6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.650149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ec5be-fa09-45fd-9d86-c2e4f84ceb75 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.651770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 39/79] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/users/317d8f3194da47098daad34218067fb6 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.652532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec5be-fa09-45fd-9d86-c2e4f84ceb75 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.665474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c1534-85cd-409e-8f98-7de34152333f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.675105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.699363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea1639-3574-495f-aeec-12fd730edd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.700129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea1639-3574-495f-aeec-12fd730edd05 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.700697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea1639-3574-495f-aeec-12fd730edd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.700697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea1639-3574-495f-aeec-12fd730edd05 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.701322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea1639-3574-495f-aeec-12fd730edd05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.702807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea1639-3574-495f-aeec-12fd730edd05 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.730002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 41/80] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:45:43 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:43.730821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea1639-3574-495f-aeec-12fd730edd05 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.766876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec5be-fa09-45fd-9d86-c2e4f84ceb75 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.805134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748a60f-8c5c-42b2-a44a-c17e343d166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.805788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a60f-8c5c-42b2-a44a-c17e343d166b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.806067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a60f-8c5c-42b2-a44a-c17e343d166b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.806345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a60f-8c5c-42b2-a44a-c17e343d166b None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.807585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748a60f-8c5c-42b2-a44a-c17e343d166b None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.809050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748a60f-8c5c-42b2-a44a-c17e343d166b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.810781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 40/81] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:43.811567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748a60f-8c5c-42b2-a44a-c17e343d166b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.864363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea1639-3574-495f-aeec-12fd730edd05 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.909724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.918986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5dd70-adec-488e-9300-2aba03b02349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.919383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:43.920035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd70-adec-488e-9300-2aba03b02349 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.920648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd70-adec-488e-9300-2aba03b02349 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.921298 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd70-adec-488e-9300-2aba03b02349 None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff/users/7e37cdb10c97478cae45037ee23ff133/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:43.924174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5dd70-adec-488e-9300-2aba03b02349 None admin] RBAC: Authorizing `identity:create_grant(project_id=b218b47344fc483aafd8820bac65f2ff, user_id=7e37cdb10c97478cae45037ee23ff133, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:43.925644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5dd70-adec-488e-9300-2aba03b02349 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:43.937379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748a60f-8c5c-42b2-a44a-c17e343d166b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:43.941388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 42/82] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:45:43 2022] PUT /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff/users/7e37cdb10c97478cae45037ee23ff133/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:45:43.942234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5dd70-adec-488e-9300-2aba03b02349 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:43.997319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989cf5f-5f70-41cf-8a27-2611fd5bd69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:43.998368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989cf5f-5f70-41cf-8a27-2611fd5bd69e None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:43.998879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989cf5f-5f70-41cf-8a27-2611fd5bd69e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:43.999396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989cf5f-5f70-41cf-8a27-2611fd5bd69e None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff/users/317d8f3194da47098daad34218067fb6/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:44.002845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989cf5f-5f70-41cf-8a27-2611fd5bd69e None admin] RBAC: Authorizing `identity:create_grant(project_id=b218b47344fc483aafd8820bac65f2ff, user_id=317d8f3194da47098daad34218067fb6, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:44.004419 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989cf5f-5f70-41cf-8a27-2611fd5bd69e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:44.030731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 41/83] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:45:43 2022] PUT /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff/users/317d8f3194da47098daad34218067fb6/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:45:44.032174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989cf5f-5f70-41cf-8a27-2611fd5bd69e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:44.093024 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5dd70-adec-488e-9300-2aba03b02349 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:44.139505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0a84f-ab11-44e6-a05b-53529748562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:44.140234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a84f-ab11-44e6-a05b-53529748562c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:44.141041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a84f-ab11-44e6-a05b-53529748562c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:44.141041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a84f-ab11-44e6-a05b-53529748562c None admin] PATH_INFO: `/v3/projects/57b2ec0151334162aaaa23d45a3653d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:44.142226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0a84f-ab11-44e6-a05b-53529748562c None admin] RBAC: Authorizing `identity:get_project(project_id=57b2ec0151334162aaaa23d45a3653d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:44.144162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0a84f-ab11-44e6-a05b-53529748562c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:44.145940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 43/84] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:43 2022] GET /identity/v3/projects/57b2ec0151334162aaaa23d45a3653d1 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:44.152817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0a84f-ab11-44e6-a05b-53529748562c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:44.173689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989cf5f-5f70-41cf-8a27-2611fd5bd69e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:44.223311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ab8f-bb67-44ab-927d-e96166ad8871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:44.224329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ab8f-bb67-44ab-927d-e96166ad8871 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:44.224763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ab8f-bb67-44ab-927d-e96166ad8871 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:44.225300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ab8f-bb67-44ab-927d-e96166ad8871 None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff/users/317d8f3194da47098daad34218067fb6/roles/916b82353e034dbd9ae74f32d945ac09` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:44.228072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ab8f-bb67-44ab-927d-e96166ad8871 None admin] RBAC: Authorizing `identity:create_grant(project_id=b218b47344fc483aafd8820bac65f2ff, user_id=317d8f3194da47098daad34218067fb6, role_id=916b82353e034dbd9ae74f32d945ac09)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:44.229751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ab8f-bb67-44ab-927d-e96166ad8871 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:44.248545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:44.250064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 42/85] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:45:44 2022] PUT /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff/users/317d8f3194da47098daad34218067fb6/roles/916b82353e034dbd9ae74f32d945ac09 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:45:44.308756 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0a84f-ab11-44e6-a05b-53529748562c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:44.351819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd49b99-d367-423e-a634-ff594703224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:44.352784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd49b99-d367-423e-a634-ff594703224c None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:44.353213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd49b99-d367-423e-a634-ff594703224c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:44.353638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd49b99-d367-423e-a634-ff594703224c None admin] PATH_INFO: `/v3/projects/57b2ec0151334162aaaa23d45a3653d1/users/317d8f3194da47098daad34218067fb6/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:44.355926 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd49b99-d367-423e-a634-ff594703224c None admin] RBAC: Authorizing `identity:create_grant(project_id=57b2ec0151334162aaaa23d45a3653d1, user_id=317d8f3194da47098daad34218067fb6, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:44.357580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd49b99-d367-423e-a634-ff594703224c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:44.382462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 44/86] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:45:44 2022] PUT /identity/v3/projects/57b2ec0151334162aaaa23d45a3653d1/users/317d8f3194da47098daad34218067fb6/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:45:46.593217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9f8a-3f71-43b0-a487-5e7dbd188c67 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:46.593727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9f8a-3f71-43b0-a487-5e7dbd188c67 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:46.593800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9f8a-3f71-43b0-a487-5e7dbd188c67 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:46.595962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 43/87] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:46.608087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa78e7-56b9-4878-939e-712a8e25e67a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:46.608550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa78e7-56b9-4878-939e-712a8e25e67a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:46.608763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa78e7-56b9-4878-939e-712a8e25e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:46.639563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2faa78e7-56b9-4878-939e-712a8e25e67a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:46.640792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2faa78e7-56b9-4878-939e-712a8e25e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:46.729008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 45/88] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:47.277788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed9f8a-3f71-43b0-a487-5e7dbd188c67 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:47.290741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:47.379180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79c04e-b28c-4d2e-bb2c-365286e38aa0 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:47.379559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79c04e-b28c-4d2e-bb2c-365286e38aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:47.379749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79c04e-b28c-4d2e-bb2c-365286e38aa0 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:47.381379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 46/89] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:47.386953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f994b56-63d7-458a-bc8b-3e054921bf81 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:47.387246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f994b56-63d7-458a-bc8b-3e054921bf81 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:47.387524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f994b56-63d7-458a-bc8b-3e054921bf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:47.406002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed9f8a-3f71-43b0-a487-5e7dbd188c67 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:47.427067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6f994b56-63d7-458a-bc8b-3e054921bf81 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:47.428269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6f994b56-63d7-458a-bc8b-3e054921bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:47.443876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9d8d7-7ed9-43be-aa7c-06f2d9bc805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:47.444915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d8d7-7ed9-43be-aa7c-06f2d9bc805a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:47.445408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d8d7-7ed9-43be-aa7c-06f2d9bc805a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:47.445877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d8d7-7ed9-43be-aa7c-06f2d9bc805a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:47.458598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9d8d7-7ed9-43be-aa7c-06f2d9bc805a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f3c9d8d7-7ed9-43be-aa7c-06f2d9bc805a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:47.464577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:47.465408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:45:47.466149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:47.468780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 44/90] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:47.478599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9d8d7-7ed9-43be-aa7c-06f2d9bc805a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:47.531318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:47.578250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 47/91] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:47.579716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a433-91a3-4148-9340-192abe41dff1 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:47.580010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a433-91a3-4148-9340-192abe41dff1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:47.580328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a433-91a3-4148-9340-192abe41dff1 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:47.581548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 48/92] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:47.588215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32836b7-0b88-48ed-8634-ae32ea6354f3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:47.588509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32836b7-0b88-48ed-8634-ae32ea6354f3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:47.588788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32836b7-0b88-48ed-8634-ae32ea6354f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:47.624752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c32836b7-0b88-48ed-8634-ae32ea6354f3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:47.626018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c32836b7-0b88-48ed-8634-ae32ea6354f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:47.634908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:47.694375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9d8d7-7ed9-43be-aa7c-06f2d9bc805a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:47.756484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 49/93] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:45:47.763252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:47.763892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:47.764174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:47.764452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:47.765139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:47.765448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:47.766918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:47.769970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80967f29-c0c3-45b3-8a0f-73d34024410a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:47.771094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80967f29-c0c3-45b3-8a0f-73d34024410a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:47.771094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80967f29-c0c3-45b3-8a0f-73d34024410a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:47.774569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 50/94] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:45:47.781803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 45/95] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:45:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:47.787969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:47.788549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee368c-20cf-4149-84c0-c632d8dbde69 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:47.789014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee368c-20cf-4149-84c0-c632d8dbde69 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:47.789477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee368c-20cf-4149-84c0-c632d8dbde69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:47.824702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4bee368c-20cf-4149-84c0-c632d8dbde69 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:47.825928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4bee368c-20cf-4149-84c0-c632d8dbde69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:47.941261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 51/96] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:47.942171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee368c-20cf-4149-84c0-c632d8dbde69 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:47.976369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cca8ae-1383-4fc0-b0c9-ebfad1ddc590 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:47.986988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:48.011699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:48.018406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7dcc9-c205-4f9f-978a-64cc8cfc1bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.019085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7dcc9-c205-4f9f-978a-64cc8cfc1bed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.019367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7dcc9-c205-4f9f-978a-64cc8cfc1bed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.019645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7dcc9-c205-4f9f-978a-64cc8cfc1bed None admin] PATH_INFO: `/v3/users/ebfa54e14c8549d3a1fbc9a604012af2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.033989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7dcc9-c205-4f9f-978a-64cc8cfc1bed None admin] RBAC: Authorizing `identity:get_user(user_id=ebfa54e14c8549d3a1fbc9a604012af2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:48.035424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7dcc9-c205-4f9f-978a-64cc8cfc1bed None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:48.037235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 46/97] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:47 2022] GET /identity/v3/users/ebfa54e14c8549d3a1fbc9a604012af2 => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:48.038416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291995-211b-4989-9202-aa5b309a0f3a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.038739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291995-211b-4989-9202-aa5b309a0f3a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.039013 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291995-211b-4989-9202-aa5b309a0f3a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.040216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 47/98] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:48.045306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642ab2-5ab8-40f5-a0dd-4fbcbf291472 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.045592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642ab2-5ab8-40f5-a0dd-4fbcbf291472 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.045872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642ab2-5ab8-40f5-a0dd-4fbcbf291472 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.047556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 48/99] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:48.048948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8642ab2-5ab8-40f5-a0dd-4fbcbf291472 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.071398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee368c-20cf-4149-84c0-c632d8dbde69 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.115070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75b2b7-0e0a-4e81-b365-502f26dab9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.115704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75b2b7-0e0a-4e81-b365-502f26dab9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.115983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75b2b7-0e0a-4e81-b365-502f26dab9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.116261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75b2b7-0e0a-4e81-b365-502f26dab9e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.127411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75b2b7-0e0a-4e81-b365-502f26dab9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ac75b2b7-0e0a-4e81-b365-502f26dab9e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:48.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:48.133096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 52/100] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:48.138968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667024-5a37-40ff-a2de-214d088bfe33 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.139638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667024-5a37-40ff-a2de-214d088bfe33 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.139638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667024-5a37-40ff-a2de-214d088bfe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.154636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d0667024-5a37-40ff-a2de-214d088bfe33 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:48.156290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d0667024-5a37-40ff-a2de-214d088bfe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:48.160256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8642ab2-5ab8-40f5-a0dd-4fbcbf291472 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.197952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f36bec-54ae-4e58-8886-10e8b775bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.198611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36bec-54ae-4e58-8886-10e8b775bef3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.198894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36bec-54ae-4e58-8886-10e8b775bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.199169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36bec-54ae-4e58-8886-10e8b775bef3 None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.200293 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f36bec-54ae-4e58-8886-10e8b775bef3 None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:48.201712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f36bec-54ae-4e58-8886-10e8b775bef3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:48.203363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 49/101] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:48 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:48.204569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221daf00-cf0a-4e99-bccf-f7d853d64e60 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.205128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221daf00-cf0a-4e99-bccf-f7d853d64e60 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.205206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221daf00-cf0a-4e99-bccf-f7d853d64e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.224092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-221daf00-cf0a-4e99-bccf-f7d853d64e60 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:48.225287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-221daf00-cf0a-4e99-bccf-f7d853d64e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:48.231432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 53/102] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:48.232092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0667024-5a37-40ff-a2de-214d088bfe33 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.265486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:48.279337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:48.298558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 50/103] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:48.299828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221daf00-cf0a-4e99-bccf-f7d853d64e60 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.356503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0667024-5a37-40ff-a2de-214d088bfe33 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.397960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c667a-213d-4360-9099-3325905b5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.398739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c667a-213d-4360-9099-3325905b5348 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.399066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c667a-213d-4360-9099-3325905b5348 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.399345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c667a-213d-4360-9099-3325905b5348 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.410410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c667a-213d-4360-9099-3325905b5348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-479c667a-213d-4360-9099-3325905b5348 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:48.416035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:48.417431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 54/104] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:48.418788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c667a-213d-4360-9099-3325905b5348 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.428995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221daf00-cf0a-4e99-bccf-f7d853d64e60 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.465927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.466888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.467453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.467931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.468798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:48.469326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:48.471105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:48.484557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 51/105] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:48.486308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.517426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:48.534945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c667a-213d-4360-9099-3325905b5348 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.543528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:48.570081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc918d6d-0f6e-400d-b01f-bbc24812680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.570691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918d6d-0f6e-400d-b01f-bbc24812680c None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.570974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918d6d-0f6e-400d-b01f-bbc24812680c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.571248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918d6d-0f6e-400d-b01f-bbc24812680c None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff/users/ebfa54e14c8549d3a1fbc9a604012af2/roles/c481f43b9ca34894a93e66471cf203f2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.573165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc918d6d-0f6e-400d-b01f-bbc24812680c None admin] RBAC: Authorizing `identity:create_grant(project_id=b218b47344fc483aafd8820bac65f2ff, user_id=ebfa54e14c8549d3a1fbc9a604012af2, role_id=c481f43b9ca34894a93e66471cf203f2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:48.574647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc918d6d-0f6e-400d-b01f-bbc24812680c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:48.587072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 55/106] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:45:48 2022] PUT /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff/users/ebfa54e14c8549d3a1fbc9a604012af2/roles/c481f43b9ca34894a93e66471cf203f2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:45:48.587681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc918d6d-0f6e-400d-b01f-bbc24812680c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.605973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84082ac-d447-488b-952e-85cdb9906865 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.646814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0d961-c884-4aee-a68d-8305294f5edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.647503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d961-c884-4aee-a68d-8305294f5edf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.647880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d961-c884-4aee-a68d-8305294f5edf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.648161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d961-c884-4aee-a68d-8305294f5edf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.649402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0d961-c884-4aee-a68d-8305294f5edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:48.651107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0d961-c884-4aee-a68d-8305294f5edf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:48.652964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 52/107] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:48.659186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0d961-c884-4aee-a68d-8305294f5edf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.702709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc918d6d-0f6e-400d-b01f-bbc24812680c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.742845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.744320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.744320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.744320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.744833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:48.745143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:48.746580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:48.756903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 56/108] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:48.757751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.773782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:48.784881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0d961-c884-4aee-a68d-8305294f5edf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.802874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:48.822179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90599c6d-3073-477b-9c35-2fe3fc795510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.822763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90599c6d-3073-477b-9c35-2fe3fc795510 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.823055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90599c6d-3073-477b-9c35-2fe3fc795510 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.823334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90599c6d-3073-477b-9c35-2fe3fc795510 None admin] PATH_INFO: `/v3/users/317d8f3194da47098daad34218067fb6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.824545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90599c6d-3073-477b-9c35-2fe3fc795510 None admin] RBAC: Authorizing `identity:get_user(user_id=317d8f3194da47098daad34218067fb6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:48.826008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90599c6d-3073-477b-9c35-2fe3fc795510 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:48.827798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 53/109] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:48 2022] GET /identity/v3/users/317d8f3194da47098daad34218067fb6 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:48.828373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90599c6d-3073-477b-9c35-2fe3fc795510 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.875730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57637a51-8a4d-4b70-a9d8-c76d00355c8a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.916594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf31e9-8e20-4b5b-91f3-9ef520afab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.917239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf31e9-8e20-4b5b-91f3-9ef520afab3b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.917528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf31e9-8e20-4b5b-91f3-9ef520afab3b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.917809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf31e9-8e20-4b5b-91f3-9ef520afab3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.929159 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf31e9-8e20-4b5b-91f3-9ef520afab3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6baf31e9-8e20-4b5b-91f3-9ef520afab3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:48.934640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:48.935493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:45:48.936255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:48.936845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 57/110] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:45:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:48.937386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf31e9-8e20-4b5b-91f3-9ef520afab3b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:48.948146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90599c6d-3073-477b-9c35-2fe3fc795510 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:48.983506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f7e4-7acd-4e8b-8e76-63b3c0694f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:48.984146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f7e4-7acd-4e8b-8e76-63b3c0694f13 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:48.984429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f7e4-7acd-4e8b-8e76-63b3c0694f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:48.984709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f7e4-7acd-4e8b-8e76-63b3c0694f13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:48.996540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69f7e4-7acd-4e8b-8e76-63b3c0694f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-bf69f7e4-7acd-4e8b-8e76-63b3c0694f13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:49.002789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:49.003842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:49.004614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 54/111] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:49.005275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f7e4-7acd-4e8b-8e76-63b3c0694f13 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:49.013141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:49.048690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf31e9-8e20-4b5b-91f3-9ef520afab3b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:49.059777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:49.084151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5023573-279b-47ce-be3e-8bdb04995156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:49.084576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5023573-279b-47ce-be3e-8bdb04995156 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:49.084860 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5023573-279b-47ce-be3e-8bdb04995156 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:49.085135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5023573-279b-47ce-be3e-8bdb04995156 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:49.085790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5023573-279b-47ce-be3e-8bdb04995156 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:49.087295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5023573-279b-47ce-be3e-8bdb04995156 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:49.118645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 58/112] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:45:48 2022] POST /identity/v3/projects => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:49.118645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5023573-279b-47ce-be3e-8bdb04995156 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:49.131294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f7e4-7acd-4e8b-8e76-63b3c0694f13 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:49.180197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46111f9a-b403-4358-8c18-c44c0064b423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:49.181667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111f9a-b403-4358-8c18-c44c0064b423 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:49.182130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111f9a-b403-4358-8c18-c44c0064b423 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:49.183072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111f9a-b403-4358-8c18-c44c0064b423 None admin] PATH_INFO: `/v3/users/7e37cdb10c97478cae45037ee23ff133` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:49.184859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46111f9a-b403-4358-8c18-c44c0064b423 None admin] RBAC: Authorizing `identity:get_user(user_id=7e37cdb10c97478cae45037ee23ff133)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:49.187407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46111f9a-b403-4358-8c18-c44c0064b423 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:49.190040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 55/113] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/users/7e37cdb10c97478cae45037ee23ff133 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:49.195346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46111f9a-b403-4358-8c18-c44c0064b423 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:49.263253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5023573-279b-47ce-be3e-8bdb04995156 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:49.296237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:49.316389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf748e06-3c9c-41e0-8500-6737cee2770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:49.317016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf748e06-3c9c-41e0-8500-6737cee2770c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:49.317301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf748e06-3c9c-41e0-8500-6737cee2770c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:49.317581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf748e06-3c9c-41e0-8500-6737cee2770c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:49.352160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46111f9a-b403-4358-8c18-c44c0064b423 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:49.368918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:49.400259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:49.400719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf748e06-3c9c-41e0-8500-6737cee2770c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:49.400919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:49.401163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:49.401445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:49.402121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:49.402431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:49.403755 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf748e06-3c9c-41e0-8500-6737cee2770c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:49.403859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:49.414736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 56/114] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:49.415879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:49.528912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 59/115] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:45:49.528912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf748e06-3c9c-41e0-8500-6737cee2770c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:49.551953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:49.556945 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25fd1-a3c7-4440-b645-0abead0300e6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:49.591660 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:49.592622 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:49.593121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:49.593567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:49.594395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:49.595392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:49.596927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:49.605755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 57/116] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:49.611587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:49.636734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf748e06-3c9c-41e0-8500-6737cee2770c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:49.649043 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:49.687212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593232d3-2155-40ec-ad59-bc92ecbf4a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:49.687945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593232d3-2155-40ec-ad59-bc92ecbf4a63 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:49.688294 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593232d3-2155-40ec-ad59-bc92ecbf4a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:49.689037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593232d3-2155-40ec-ad59-bc92ecbf4a63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:49.731342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3ce2d-a914-48b0-a7f7-ac60b3abc277 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:49.771829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593232d3-2155-40ec-ad59-bc92ecbf4a63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:49.773324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593232d3-2155-40ec-ad59-bc92ecbf4a63 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:49.779257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1437-a1f2-4edd-b790-b75c683151fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:49.780519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1437-a1f2-4edd-b790-b75c683151fd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:49.780999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1437-a1f2-4edd-b790-b75c683151fd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:49.781940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1437-a1f2-4edd-b790-b75c683151fd None admin] PATH_INFO: `/v3/users/317d8f3194da47098daad34218067fb6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:49.784246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1437-a1f2-4edd-b790-b75c683151fd None admin] RBAC: Authorizing `identity:get_user(user_id=317d8f3194da47098daad34218067fb6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:49.786674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1437-a1f2-4edd-b790-b75c683151fd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:49.788682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 58/117] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/users/317d8f3194da47098daad34218067fb6 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:49.789751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1437-a1f2-4edd-b790-b75c683151fd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:49.797915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:49.886382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 60/118] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:45:49.887634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593232d3-2155-40ec-ad59-bc92ecbf4a63 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:49.910731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1437-a1f2-4edd-b790-b75c683151fd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:49.913198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:49.948867 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be872a6a-2eb6-4388-89b0-5ec4f8154c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:49.949604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872a6a-2eb6-4388-89b0-5ec4f8154c5f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:49.949954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872a6a-2eb6-4388-89b0-5ec4f8154c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:49.950301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872a6a-2eb6-4388-89b0-5ec4f8154c5f None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:49.951685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be872a6a-2eb6-4388-89b0-5ec4f8154c5f None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:49.953847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be872a6a-2eb6-4388-89b0-5ec4f8154c5f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:49.956449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 59/119] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:49.961790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be872a6a-2eb6-4388-89b0-5ec4f8154c5f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:50.003771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593232d3-2155-40ec-ad59-bc92ecbf4a63 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:50.027700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:50.041181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e791e-f459-4dce-a947-3ede1bd9f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:50.042036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e791e-f459-4dce-a947-3ede1bd9f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.042514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e791e-f459-4dce-a947-3ede1bd9f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.042977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e791e-f459-4dce-a947-3ede1bd9f6c7 None admin] PATH_INFO: `/v3/users/317d8f3194da47098daad34218067fb6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.044275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e791e-f459-4dce-a947-3ede1bd9f6c7 None admin] RBAC: Authorizing `identity:get_user(user_id=317d8f3194da47098daad34218067fb6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:50.045943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e791e-f459-4dce-a947-3ede1bd9f6c7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:50.048085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 61/120] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/users/317d8f3194da47098daad34218067fb6 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:50.049068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e791e-f459-4dce-a947-3ede1bd9f6c7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:50.084739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be872a6a-2eb6-4388-89b0-5ec4f8154c5f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:50.126680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edeca3-e2e2-4bbe-a46b-86b77b046902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:50.127895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edeca3-e2e2-4bbe-a46b-86b77b046902 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.128376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edeca3-e2e2-4bbe-a46b-86b77b046902 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.128868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edeca3-e2e2-4bbe-a46b-86b77b046902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.184505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e791e-f459-4dce-a947-3ede1bd9f6c7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:50.185074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:50.222824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac98a8-fd89-449f-a63f-27d87369c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:50.223675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edeca3-e2e2-4bbe-a46b-86b77b046902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:50.224060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac98a8-fd89-449f-a63f-27d87369c481 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.224533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac98a8-fd89-449f-a63f-27d87369c481 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.224999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac98a8-fd89-449f-a63f-27d87369c481 None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.225167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edeca3-e2e2-4bbe-a46b-86b77b046902 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:50.226576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac98a8-fd89-449f-a63f-27d87369c481 None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:50.228215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac98a8-fd89-449f-a63f-27d87369c481 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:50.230114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 62/121] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:50 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:50.231271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac98a8-fd89-449f-a63f-27d87369c481 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:50.309293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:50.343574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 60/122] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:45:50.345512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edeca3-e2e2-4bbe-a46b-86b77b046902 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:50.364432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac98a8-fd89-449f-a63f-27d87369c481 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:50.399847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:50.400511 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.400800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.401074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.401803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] RBAC: Adding query filter params (role.id=f9fed2e211414db0aa72e25fcc59d6f8, scope.project.id=b218b47344fc483aafd8820bac65f2ff, user.id=317d8f3194da47098daad34218067fb6) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:50.402109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:50.403723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:50.414687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 63/123] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:45:50 2022] GET /identity/v3/role_assignments?user.id=317d8f3194da47098daad34218067fb6&scope.project.id=b218b47344fc483aafd8820bac65f2ff&role.id=f9fed2e211414db0aa72e25fcc59d6f8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:50.414687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:50.482786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:50.533822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edeca3-e2e2-4bbe-a46b-86b77b046902 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:50.601859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46324fd-1661-438c-9528-0a632d9e30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:50.602489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46324fd-1661-438c-9528-0a632d9e30ca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.602793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46324fd-1661-438c-9528-0a632d9e30ca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.603068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46324fd-1661-438c-9528-0a632d9e30ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.629086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dca2f-aacd-4bb0-b52e-244a5cef0839 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:50.656732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:50.672849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:50.674993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.675512 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.675990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.676955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=b218b47344fc483aafd8820bac65f2ff, user.id=7e37cdb10c97478cae45037ee23ff133) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:50.677486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:50.679334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:50.684918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46324fd-1661-438c-9528-0a632d9e30ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:50.686493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46324fd-1661-438c-9528-0a632d9e30ca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:50.687335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 64/124] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:45:50 2022] GET /identity/v3/role_assignments?user.id=7e37cdb10c97478cae45037ee23ff133&scope.project.id=b218b47344fc483aafd8820bac65f2ff&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:50.688410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:50.781695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:50.833677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 61/125] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:45:50.834195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d58e8-214f-41ec-904a-b79d5a5f91fd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.834368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d58e8-214f-41ec-904a-b79d5a5f91fd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.834845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d58e8-214f-41ec-904a-b79d5a5f91fd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.836471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 62/126] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:50.838694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d58e8-214f-41ec-904a-b79d5a5f91fd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:50.868845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791cc46-ff08-4dd9-9294-f09553a76d4c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:50.917426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdceae-5f07-4ed5-aca7-0faa64aaac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:50.918649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdceae-5f07-4ed5-aca7-0faa64aaac4e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.919136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdceae-5f07-4ed5-aca7-0faa64aaac4e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.919636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdceae-5f07-4ed5-aca7-0faa64aaac4e None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.921579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdceae-5f07-4ed5-aca7-0faa64aaac4e None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:50.924228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdceae-5f07-4ed5-aca7-0faa64aaac4e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:50.926502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 65/127] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:50 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:50.928127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898eed-46d1-4750-ae38-c5f5a2948a7a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:50.928651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898eed-46d1-4750-ae38-c5f5a2948a7a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:50.929124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898eed-46d1-4750-ae38-c5f5a2948a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:50.950208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c8898eed-46d1-4750-ae38-c5f5a2948a7a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:50.951887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c8898eed-46d1-4750-ae38-c5f5a2948a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:50.966240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d58e8-214f-41ec-904a-b79d5a5f91fd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:51.018889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9a1f-714c-48c3-b305-4d7078f3937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:51.019691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9a1f-714c-48c3-b305-4d7078f3937b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.019933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:51.020037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9a1f-714c-48c3-b305-4d7078f3937b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.020249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9a1f-714c-48c3-b305-4d7078f3937b None admin] PATH_INFO: `/v3/projects/57b2ec0151334162aaaa23d45a3653d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.026314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda9a1f-714c-48c3-b305-4d7078f3937b None admin] RBAC: Authorizing `identity:get_project(project_id=57b2ec0151334162aaaa23d45a3653d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:51.026314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda9a1f-714c-48c3-b305-4d7078f3937b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:51.028576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 63/128] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:50 2022] GET /identity/v3/projects/57b2ec0151334162aaaa23d45a3653d1 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:51.029217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9a1f-714c-48c3-b305-4d7078f3937b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:51.039752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 66/129] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:51.040685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898eed-46d1-4750-ae38-c5f5a2948a7a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:51.081169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:51.149341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9a1f-714c-48c3-b305-4d7078f3937b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:51.150460 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898eed-46d1-4750-ae38-c5f5a2948a7a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:51.190778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:51.191563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.191939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.192221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.192961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] RBAC: Adding query filter params (role.id=916b82353e034dbd9ae74f32d945ac09, scope.project.id=b218b47344fc483aafd8820bac65f2ff, user.id=317d8f3194da47098daad34218067fb6) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:51.193273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:51.194745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:51.196438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:51.197516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.198070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.198568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.199573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] RBAC: Adding query filter params (role.id=f9fed2e211414db0aa72e25fcc59d6f8, scope.project.id=57b2ec0151334162aaaa23d45a3653d1, user.id=317d8f3194da47098daad34218067fb6) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:51.200608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:51.202476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:51.203588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 64/130] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:45:51 2022] GET /identity/v3/role_assignments?user.id=317d8f3194da47098daad34218067fb6&scope.project.id=b218b47344fc483aafd8820bac65f2ff&role.id=916b82353e034dbd9ae74f32d945ac09 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:51.210168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 67/131] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:45:51 2022] GET /identity/v3/role_assignments?user.id=317d8f3194da47098daad34218067fb6&scope.project.id=57b2ec0151334162aaaa23d45a3653d1&role.id=f9fed2e211414db0aa72e25fcc59d6f8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:51.345828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:51.466066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968772da-6788-4a39-9ffa-be42d7149afd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:51.470097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:51.504245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774578a-f22c-476b-a455-c834a101497b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:51.504889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774578a-f22c-476b-a455-c834a101497b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.505177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774578a-f22c-476b-a455-c834a101497b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.505456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774578a-f22c-476b-a455-c834a101497b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.515798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774578a-f22c-476b-a455-c834a101497b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8774578a-f22c-476b-a455-c834a101497b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:51.520672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:51.521501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:51.522446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 65/132] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:51.527661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:51.531062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad188e68-5773-42b0-b063-f11df12a73a0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.531354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad188e68-5773-42b0-b063-f11df12a73a0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.531634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad188e68-5773-42b0-b063-f11df12a73a0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.533451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 66/133] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:45:51.538560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8b79-9e55-4b51-b0a0-7594fabc79a7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.538833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8b79-9e55-4b51-b0a0-7594fabc79a7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.539108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8b79-9e55-4b51-b0a0-7594fabc79a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.557133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-513c8b79-9e55-4b51-b0a0-7594fabc79a7 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:51.558306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-513c8b79-9e55-4b51-b0a0-7594fabc79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:51.576688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:51.624999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 67/134] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:45:51.629559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736c17-38d0-46df-a70d-065af0664488 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:51.662505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:51.663138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.663424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.663701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.664368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:51.664676 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:51.666048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:51.674446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 68/135] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:45:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:51.680064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8b79-9e55-4b51-b0a0-7594fabc79a7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:51.770498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:51.778346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8b79-9e55-4b51-b0a0-7594fabc79a7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:51.811386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaea1fe-8f68-4c3c-ae2d-e644e1748ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:51.812043 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaea1fe-8f68-4c3c-ae2d-e644e1748ffb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.812321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaea1fe-8f68-4c3c-ae2d-e644e1748ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.812592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaea1fe-8f68-4c3c-ae2d-e644e1748ffb None admin] PATH_INFO: `/v3/users/ebfa54e14c8549d3a1fbc9a604012af2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.813777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaea1fe-8f68-4c3c-ae2d-e644e1748ffb None admin] RBAC: Authorizing `identity:get_user(user_id=ebfa54e14c8549d3a1fbc9a604012af2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:51.815250 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaea1fe-8f68-4c3c-ae2d-e644e1748ffb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:51.816811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 68/136] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:51 2022] GET /identity/v3/users/ebfa54e14c8549d3a1fbc9a604012af2 => generated 289 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:51.822374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:51.890871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaea1fe-8f68-4c3c-ae2d-e644e1748ffb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:51.923308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5f184-74bf-430a-a86b-8096a2afd709 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:51.933562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:51.957398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2b92-1c88-4eac-ada8-4b1413e341b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:51.957998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2b92-1c88-4eac-ada8-4b1413e341b7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:51.958277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2b92-1c88-4eac-ada8-4b1413e341b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:51.958574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2b92-1c88-4eac-ada8-4b1413e341b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:51.994381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaea1fe-8f68-4c3c-ae2d-e644e1748ffb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:52.024213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa2b92-1c88-4eac-ada8-4b1413e341b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:52.025676 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa2b92-1c88-4eac-ada8-4b1413e341b7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:52.028113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871093-aaca-401e-9e26-a8588697cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:52.028747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871093-aaca-401e-9e26-a8588697cfbb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:52.029033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871093-aaca-401e-9e26-a8588697cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:52.029312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871093-aaca-401e-9e26-a8588697cfbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:52.030420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96871093-aaca-401e-9e26-a8588697cfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:52.031894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96871093-aaca-401e-9e26-a8588697cfbb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:52.034556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 69/137] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:52.040667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871093-aaca-401e-9e26-a8588697cfbb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:52.074402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:52.127648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 69/138] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:45:52.133136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2b92-1c88-4eac-ada8-4b1413e341b7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:52.144346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:52.147414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871093-aaca-401e-9e26-a8588697cfbb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:52.180543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba0b2b-a4ce-4ac8-9fef-f4f5a6d80fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:52.181160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba0b2b-a4ce-4ac8-9fef-f4f5a6d80fa9 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:52.181448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba0b2b-a4ce-4ac8-9fef-f4f5a6d80fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:52.181726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba0b2b-a4ce-4ac8-9fef-f4f5a6d80fa9 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:52.182390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba0b2b-a4ce-4ac8-9fef-f4f5a6d80fa9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:52.183851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba0b2b-a4ce-4ac8-9fef-f4f5a6d80fa9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:52.206466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 70/139] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:45:52 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:52.234728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2b92-1c88-4eac-ada8-4b1413e341b7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:52.272937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79f3e-fcce-485f-b092-a160b6453e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:52.273593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79f3e-fcce-485f-b092-a160b6453e13 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:52.273874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79f3e-fcce-485f-b092-a160b6453e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:52.274147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79f3e-fcce-485f-b092-a160b6453e13 None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:52.275347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff79f3e-fcce-485f-b092-a160b6453e13 None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:52.276806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff79f3e-fcce-485f-b092-a160b6453e13 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:52.278475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 70/140] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:52 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:52.285305 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba0b2b-a4ce-4ac8-9fef-f4f5a6d80fa9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:52.375085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:52.391794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba0b2b-a4ce-4ac8-9fef-f4f5a6d80fa9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:52.426449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac89ad-5413-4377-8728-cc2e7989776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:52.427030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac89ad-5413-4377-8728-cc2e7989776f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:52.427307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac89ad-5413-4377-8728-cc2e7989776f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:52.427577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac89ad-5413-4377-8728-cc2e7989776f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:52.428305 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac89ad-5413-4377-8728-cc2e7989776f None admin] RBAC: Adding query filter params (role.id=c481f43b9ca34894a93e66471cf203f2, scope.project.id=b218b47344fc483aafd8820bac65f2ff, user.id=ebfa54e14c8549d3a1fbc9a604012af2) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:52.428610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac89ad-5413-4377-8728-cc2e7989776f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:52.430052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac89ad-5413-4377-8728-cc2e7989776f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:52.435798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 71/141] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:45:52 2022] GET /identity/v3/role_assignments?user.id=ebfa54e14c8549d3a1fbc9a604012af2&scope.project.id=b218b47344fc483aafd8820bac65f2ff&role.id=c481f43b9ca34894a93e66471cf203f2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:54.470848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b143b3-1984-4442-b558-28d0cd4230ec None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:54.471433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b143b3-1984-4442-b558-28d0cd4230ec None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:54.471713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b143b3-1984-4442-b558-28d0cd4230ec None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:54.473421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 71/142] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:54.480126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455c39-ac4d-4333-883b-d9c0bdb1bc65 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:54.481080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455c39-ac4d-4333-883b-d9c0bdb1bc65 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:54.481636 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455c39-ac4d-4333-883b-d9c0bdb1bc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:54.503799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8b455c39-ac4d-4333-883b-d9c0bdb1bc65 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:54.505428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8b455c39-ac4d-4333-883b-d9c0bdb1bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:54.580738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 72/143] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:54.594113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706d33-5392-4302-bd4f-0a68591a1d7e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:54.594396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706d33-5392-4302-bd4f-0a68591a1d7e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:54.595213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e706d33-5392-4302-bd4f-0a68591a1d7e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:54.597092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 72/144] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:45:54.602343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce852f-d374-4ee3-ab38-e1c9882222c2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:54.602664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce852f-d374-4ee3-ab38-e1c9882222c2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:54.602942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce852f-d374-4ee3-ab38-e1c9882222c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:54.621755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fcce852f-d374-4ee3-ab38-e1c9882222c2 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:54.622968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fcce852f-d374-4ee3-ab38-e1c9882222c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:54.631665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7ed30-9c0a-476f-80ca-25ac30045d8c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:54.631991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7ed30-9c0a-476f-80ca-25ac30045d8c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:54.632226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7ed30-9c0a-476f-80ca-25ac30045d8c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:54.633680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 73/145] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:54.638288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278d22-fa53-43bc-802f-a9ceb8903e98 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:54.638592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278d22-fa53-43bc-802f-a9ceb8903e98 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:54.638868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278d22-fa53-43bc-802f-a9ceb8903e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:54.656475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f0278d22-fa53-43bc-802f-a9ceb8903e98 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:54.658199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f0278d22-fa53-43bc-802f-a9ceb8903e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:54.692577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 73/146] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:45:54.731723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 74/147] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:45:54.859476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce852f-d374-4ee3-ab38-e1c9882222c2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:54.872527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:54.963483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce852f-d374-4ee3-ab38-e1c9882222c2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:54.976156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278d22-fa53-43bc-802f-a9ceb8903e98 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:54.986433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.001307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41d432-7fff-4d98-b80a-40485f71d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.002197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41d432-7fff-4d98-b80a-40485f71d69b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.002473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41d432-7fff-4d98-b80a-40485f71d69b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.002774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41d432-7fff-4d98-b80a-40485f71d69b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.012844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41d432-7fff-4d98-b80a-40485f71d69b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4f41d432-7fff-4d98-b80a-40485f71d69b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:55.018217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:55.019156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 74/148] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:45:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:55.020939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41d432-7fff-4d98-b80a-40485f71d69b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.076667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278d22-fa53-43bc-802f-a9ceb8903e98 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.090846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.111261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a3c5c-f29c-4e3d-830f-f151ac1eae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.111901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3c5c-f29c-4e3d-830f-f151ac1eae3f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.112180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3c5c-f29c-4e3d-830f-f151ac1eae3f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.112455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3c5c-f29c-4e3d-830f-f151ac1eae3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.122339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a3c5c-f29c-4e3d-830f-f151ac1eae3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:55.122466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41d432-7fff-4d98-b80a-40485f71d69b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-db1a3c5c-f29c-4e3d-830f-f151ac1eae3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:55.127520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:55.128426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:55.129187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 75/149] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:45:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:45:55.129835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a3c5c-f29c-4e3d-830f-f151ac1eae3f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.157995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57411e67-738f-4995-a2bb-c8eac64e968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.158651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57411e67-738f-4995-a2bb-c8eac64e968e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.158939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57411e67-738f-4995-a2bb-c8eac64e968e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.159215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57411e67-738f-4995-a2bb-c8eac64e968e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.160333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57411e67-738f-4995-a2bb-c8eac64e968e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.162061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57411e67-738f-4995-a2bb-c8eac64e968e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.164973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 75/150] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:55.164973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57411e67-738f-4995-a2bb-c8eac64e968e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.195042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.228799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a3c5c-f29c-4e3d-830f-f151ac1eae3f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.261697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.262102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57411e67-738f-4995-a2bb-c8eac64e968e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.262210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.262480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.262775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.263424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:55.263720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.265090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.273373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 76/151] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:55.274126 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.298947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.299554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.299834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.300108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.300765 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:55.301069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.302436 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.307404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.310937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 76/152] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:45:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:55.311728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.371338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50475aa4-6033-442f-95a5-9ab0f9b3dcd5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.399614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.405623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9b08-77d1-402f-a209-9e9dfcc63f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.406002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9b08-77d1-402f-a209-9e9dfcc63f94 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.406280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9b08-77d1-402f-a209-9e9dfcc63f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.406577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9b08-77d1-402f-a209-9e9dfcc63f94 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.407259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f9b08-77d1-402f-a209-9e9dfcc63f94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.408854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f9b08-77d1-402f-a209-9e9dfcc63f94 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.413757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0457b1-c496-413a-afd9-41b4a8aa6caa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.428701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 77/153] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:45:55 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:55.429841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9b08-77d1-402f-a209-9e9dfcc63f94 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.458003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2da5-a91c-475d-8fec-091c0a69ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.458722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2da5-a91c-475d-8fec-091c0a69ab4a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.459101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2da5-a91c-475d-8fec-091c0a69ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.459286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2da5-a91c-475d-8fec-091c0a69ab4a None admin] PATH_INFO: `/v3/users/ca7b0998c27a4f2c859f2845411cebe4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.477111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f2da5-a91c-475d-8fec-091c0a69ab4a None admin] RBAC: Authorizing `identity:get_user(user_id=ca7b0998c27a4f2c859f2845411cebe4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.478641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f2da5-a91c-475d-8fec-091c0a69ab4a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.480366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 77/154] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:55 2022] GET /identity/v3/users/ca7b0998c27a4f2c859f2845411cebe4 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:55.486697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2da5-a91c-475d-8fec-091c0a69ab4a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.551007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.569396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9b08-77d1-402f-a209-9e9dfcc63f94 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.596413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2da5-a91c-475d-8fec-091c0a69ab4a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.607900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577085b-d98a-4e2a-89de-8761c6bb2239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.608869 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577085b-d98a-4e2a-89de-8761c6bb2239 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.609087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577085b-d98a-4e2a-89de-8761c6bb2239 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.609314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577085b-d98a-4e2a-89de-8761c6bb2239 None admin] PATH_INFO: `/v3/users/ca7b0998c27a4f2c859f2845411cebe4` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.611151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577085b-d98a-4e2a-89de-8761c6bb2239 None admin] RBAC: Authorizing `identity:get_user(user_id=ca7b0998c27a4f2c859f2845411cebe4)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.612824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577085b-d98a-4e2a-89de-8761c6bb2239 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.614786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 78/155] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:55 2022] GET /identity/v3/users/ca7b0998c27a4f2c859f2845411cebe4 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:55.620277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577085b-d98a-4e2a-89de-8761c6bb2239 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.637181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38bbda-6e48-4a4a-b3b7-df35c6b89c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.637811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bbda-6e48-4a4a-b3b7-df35c6b89c02 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.638089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bbda-6e48-4a4a-b3b7-df35c6b89c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.638731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bbda-6e48-4a4a-b3b7-df35c6b89c02 None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.639629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38bbda-6e48-4a4a-b3b7-df35c6b89c02 None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.641109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38bbda-6e48-4a4a-b3b7-df35c6b89c02 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.644166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 78/156] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:55 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:55.648989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38bbda-6e48-4a4a-b3b7-df35c6b89c02 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.684699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.740694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577085b-d98a-4e2a-89de-8761c6bb2239 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.774186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38bbda-6e48-4a4a-b3b7-df35c6b89c02 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.789469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7018a2-542b-4aed-8540-4bdd12df756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.790119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7018a2-542b-4aed-8540-4bdd12df756a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.790392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7018a2-542b-4aed-8540-4bdd12df756a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.790678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7018a2-542b-4aed-8540-4bdd12df756a None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.791820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7018a2-542b-4aed-8540-4bdd12df756a None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.793257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7018a2-542b-4aed-8540-4bdd12df756a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.794914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 79/157] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:55 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:45:55.801361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7018a2-542b-4aed-8540-4bdd12df756a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:55.810624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.821933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03128fe-9f93-4978-bbdd-ad597adb93cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.822695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03128fe-9f93-4978-bbdd-ad597adb93cc None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.823034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03128fe-9f93-4978-bbdd-ad597adb93cc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.823304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03128fe-9f93-4978-bbdd-ad597adb93cc None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3/users/ca7b0998c27a4f2c859f2845411cebe4/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.825312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03128fe-9f93-4978-bbdd-ad597adb93cc None admin] RBAC: Authorizing `identity:create_grant(project_id=3404b245e3494ad0b5a108a32c6247e3, user_id=ca7b0998c27a4f2c859f2845411cebe4, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.826811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03128fe-9f93-4978-bbdd-ad597adb93cc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.844086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 79/158] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:45:55 2022] PUT /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3/users/ca7b0998c27a4f2c859f2845411cebe4/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:45:55.926058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7018a2-542b-4aed-8540-4bdd12df756a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:55.953639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:55.967817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d1f8a-a075-4fc5-a053-e4b441a74456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:55.968837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1f8a-a075-4fc5-a053-e4b441a74456 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:55.969255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1f8a-a075-4fc5-a053-e4b441a74456 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:55.969766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1f8a-a075-4fc5-a053-e4b441a74456 None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3/users/ca7b0998c27a4f2c859f2845411cebe4/roles/916b82353e034dbd9ae74f32d945ac09` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:55.972973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d1f8a-a075-4fc5-a053-e4b441a74456 None admin] RBAC: Authorizing `identity:create_grant(project_id=3404b245e3494ad0b5a108a32c6247e3, user_id=ca7b0998c27a4f2c859f2845411cebe4, role_id=916b82353e034dbd9ae74f32d945ac09)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:55.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d1f8a-a075-4fc5-a053-e4b441a74456 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:55.990804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 80/159] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:45:55 2022] PUT /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3/users/ca7b0998c27a4f2c859f2845411cebe4/roles/916b82353e034dbd9ae74f32d945ac09 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:45:57.778655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37982-fbd0-4865-8ce4-739aa4633739 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:57.779172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37982-fbd0-4865-8ce4-739aa4633739 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:57.779284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37982-fbd0-4865-8ce4-739aa4633739 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:57.780793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 80/160] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:57.786848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1380-ed19-4891-8e90-4369fe2d6c09 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:57.787290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1380-ed19-4891-8e90-4369fe2d6c09 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:57.787487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1380-ed19-4891-8e90-4369fe2d6c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:57.807501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9d4d1380-ed19-4891-8e90-4369fe2d6c09 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:57.808710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9d4d1380-ed19-4891-8e90-4369fe2d6c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:57.834769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5239-0b8c-490a-8d63-576db7eee96a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:57.835389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5239-0b8c-490a-8d63-576db7eee96a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:57.835876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5239-0b8c-490a-8d63-576db7eee96a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:57.837426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 81/161] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:45:57.842426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2bbe7-2b58-4f1d-9ddf-29d4d1a3ed0f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:57.842943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2bbe7-2b58-4f1d-9ddf-29d4d1a3ed0f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:57.843415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2bbe7-2b58-4f1d-9ddf-29d4d1a3ed0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:57.863509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-02f2bbe7-2b58-4f1d-9ddf-29d4d1a3ed0f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:57.865041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-02f2bbe7-2b58-4f1d-9ddf-29d4d1a3ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:57.889227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 81/162] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:57.950976 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 82/163] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:58.083559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df690-b4bd-474e-8512-c1451a3d7e7a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.083744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df690-b4bd-474e-8512-c1451a3d7e7a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.084037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df690-b4bd-474e-8512-c1451a3d7e7a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.085455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 82/164] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:45:58.091484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010747-d508-446e-b108-de0c61886cb8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.091774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010747-d508-446e-b108-de0c61886cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.092053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010747-d508-446e-b108-de0c61886cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.111255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f8010747-d508-446e-b108-de0c61886cb8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:58.112430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f8010747-d508-446e-b108-de0c61886cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:58.181351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48df690-b4bd-474e-8512-c1451a3d7e7a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.183318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 83/165] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:45:58.189287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1b464-4cfe-40fb-87fe-f64fd1813434 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.189629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1b464-4cfe-40fb-87fe-f64fd1813434 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.189845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1b464-4cfe-40fb-87fe-f64fd1813434 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.191264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 84/166] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:45:58.196614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af21a-6911-4ec2-b67c-f833ecc87864 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.196899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af21a-6911-4ec2-b67c-f833ecc87864 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.197197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af21a-6911-4ec2-b67c-f833ecc87864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.216081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-481af21a-6911-4ec2-b67c-f833ecc87864 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:45:58.217361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-481af21a-6911-4ec2-b67c-f833ecc87864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:45:58.272048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:58.296102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48df690-b4bd-474e-8512-c1451a3d7e7a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:58.297308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 85/167] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:45:58.299469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481af21a-6911-4ec2-b67c-f833ecc87864 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.316836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:58.348737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6878-4437-4c24-b510-a4ac1d809dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:58.349285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6878-4437-4c24-b510-a4ac1d809dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.349562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6878-4437-4c24-b510-a4ac1d809dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.349831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6878-4437-4c24-b510-a4ac1d809dd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.361236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f6878-4437-4c24-b510-a4ac1d809dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-9d2f6878-4437-4c24-b510-a4ac1d809dd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:58.366320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:58.367219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:45:58.368026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:58.370868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 83/168] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:45:58.373549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6878-4437-4c24-b510-a4ac1d809dd1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.450642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481af21a-6911-4ec2-b67c-f833ecc87864 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:58.488172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a751f5-bf19-4b54-9239-7619b651d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:58.488819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a751f5-bf19-4b54-9239-7619b651d8cd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.489084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a751f5-bf19-4b54-9239-7619b651d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.489342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a751f5-bf19-4b54-9239-7619b651d8cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.490424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a751f5-bf19-4b54-9239-7619b651d8cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:58.492403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a751f5-bf19-4b54-9239-7619b651d8cd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:58.496878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 86/169] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:58.496878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a751f5-bf19-4b54-9239-7619b651d8cd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.497090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6878-4437-4c24-b510-a4ac1d809dd1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:58.533623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:58.534229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.534501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.535397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.535518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:58.535769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:58.537154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:58.545471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 84/170] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:58.546544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.550427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:58.582401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:58.608007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a751f5-bf19-4b54-9239-7619b651d8cd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:58.642334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675bd90-230c-40da-933f-90b2afa39098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:58.643067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bd90-230c-40da-933f-90b2afa39098 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.643346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bd90-230c-40da-933f-90b2afa39098 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.643621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675bd90-230c-40da-933f-90b2afa39098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.648068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7127f-12ec-4ee6-8559-0a68ebdc0a6a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:58.653495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675bd90-230c-40da-933f-90b2afa39098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1675bd90-230c-40da-933f-90b2afa39098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:58.659076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:58.659922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:45:58.660697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 87/171] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:58.661342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675bd90-230c-40da-933f-90b2afa39098 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.682489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e5cc-63e6-4dfb-afb4-0ce1f64d9f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:58.683116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e5cc-63e6-4dfb-afb4-0ce1f64d9f24 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.683393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e5cc-63e6-4dfb-afb4-0ce1f64d9f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.683660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e5cc-63e6-4dfb-afb4-0ce1f64d9f24 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.684331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243e5cc-63e6-4dfb-afb4-0ce1f64d9f24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:58.685792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243e5cc-63e6-4dfb-afb4-0ce1f64d9f24 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:58.706921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 85/172] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:45:58 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:45:58.715386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e5cc-63e6-4dfb-afb4-0ce1f64d9f24 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.781672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675bd90-230c-40da-933f-90b2afa39098 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:58.786050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:58.818727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:58.822303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a7d02-5196-4efe-ae46-1aabce751eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:58.823001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a7d02-5196-4efe-ae46-1aabce751eca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.823464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a7d02-5196-4efe-ae46-1aabce751eca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.823715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a7d02-5196-4efe-ae46-1aabce751eca None admin] PATH_INFO: `/v3/users/6b972287a3b3474a9e0e3956b444cea1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.831704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e5cc-63e6-4dfb-afb4-0ce1f64d9f24 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:58.841370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a7d02-5196-4efe-ae46-1aabce751eca None admin] RBAC: Authorizing `identity:get_user(user_id=6b972287a3b3474a9e0e3956b444cea1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:58.843283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a7d02-5196-4efe-ae46-1aabce751eca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:58.850150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 88/173] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:58 2022] GET /identity/v3/users/6b972287a3b3474a9e0e3956b444cea1 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:58.850150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a7d02-5196-4efe-ae46-1aabce751eca None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.871464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b24ae0-9093-44d0-bee9-390a9b8542f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:58.872116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b24ae0-9093-44d0-bee9-390a9b8542f9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:58.872473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b24ae0-9093-44d0-bee9-390a9b8542f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:58.872823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b24ae0-9093-44d0-bee9-390a9b8542f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:58.886746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b24ae0-9093-44d0-bee9-390a9b8542f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-45b24ae0-9093-44d0-bee9-390a9b8542f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:45:58.892827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:45:58.893841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:45:58.894654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 86/174] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:45:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:45:58.895292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b24ae0-9093-44d0-bee9-390a9b8542f9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:58.982324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a7d02-5196-4efe-ae46-1aabce751eca None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:59.029181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:59.029506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:59.029814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:59.030064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:59.030768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:59.031073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:59.033080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b24ae0-9093-44d0-bee9-390a9b8542f9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:59.033759 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:59.043422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 89/175] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:59.044325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:59.076885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:59.077390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c28df-21ae-4474-a22f-3d200629b040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:59.078447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c28df-21ae-4474-a22f-3d200629b040 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:59.078649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c28df-21ae-4474-a22f-3d200629b040 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:59.078968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c28df-21ae-4474-a22f-3d200629b040 None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:59.081205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c28df-21ae-4474-a22f-3d200629b040 None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:59.084452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c28df-21ae-4474-a22f-3d200629b040 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:59.084452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 87/176] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:58 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:59.087616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c28df-21ae-4474-a22f-3d200629b040 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:59.109201 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:59.177181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea419d8-3a07-432c-a3c4-9ab5feaa353d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:59.206175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c28df-21ae-4474-a22f-3d200629b040 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:59.221160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:59.222417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:59.222934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:59.223220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:59.224116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:45:59.224425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:59.225800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:59.235938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 90/177] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:45:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:59.237014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:59.248004 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b915d-2828-4121-891e-cacdde02f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:59.249085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b915d-2828-4121-891e-cacdde02f46c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:59.249559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b915d-2828-4121-891e-cacdde02f46c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:59.250178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b915d-2828-4121-891e-cacdde02f46c None admin] PATH_INFO: `/v3/users/ca7b0998c27a4f2c859f2845411cebe4` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:59.252074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b915d-2828-4121-891e-cacdde02f46c None admin] RBAC: Authorizing `identity:get_user(user_id=ca7b0998c27a4f2c859f2845411cebe4)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:59.254322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b915d-2828-4121-891e-cacdde02f46c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:59.256444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 88/178] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:59 2022] GET /identity/v3/users/ca7b0998c27a4f2c859f2845411cebe4 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:59.257184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b915d-2828-4121-891e-cacdde02f46c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:59.349988 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:59.352005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:59.372481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29986c0c-3b32-47d3-a4d4-e87cf7fc147a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:59.373285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b915d-2828-4121-891e-cacdde02f46c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:59.411287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac4650-2bef-4b01-b07b-c9caa57fb86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:59.412305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4650-2bef-4b01-b07b-c9caa57fb86f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:59.412789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4650-2bef-4b01-b07b-c9caa57fb86f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:59.413284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4650-2bef-4b01-b07b-c9caa57fb86f None admin] PATH_INFO: `/v3/users/ca7b0998c27a4f2c859f2845411cebe4` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:59.414655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac4650-2bef-4b01-b07b-c9caa57fb86f None admin] RBAC: Authorizing `identity:get_user(user_id=ca7b0998c27a4f2c859f2845411cebe4)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:59.416291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac4650-2bef-4b01-b07b-c9caa57fb86f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:59.416779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245ab74-0540-435b-8e4f-6945f9578a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:59.417503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ab74-0540-435b-8e4f-6945f9578a5e None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:59.417844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ab74-0540-435b-8e4f-6945f9578a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:59.418181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ab74-0540-435b-8e4f-6945f9578a5e None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3/users/6b972287a3b3474a9e0e3956b444cea1/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:59.418960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 89/179] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:45:59 2022] GET /identity/v3/users/ca7b0998c27a4f2c859f2845411cebe4 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:45:59.419961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac4650-2bef-4b01-b07b-c9caa57fb86f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:59.420234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245ab74-0540-435b-8e4f-6945f9578a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=3404b245e3494ad0b5a108a32c6247e3, user_id=6b972287a3b3474a9e0e3956b444cea1, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:59.421751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245ab74-0540-435b-8e4f-6945f9578a5e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:59.443558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 91/180] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:45:59 2022] PUT /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3/users/6b972287a3b3474a9e0e3956b444cea1/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:45:59.449589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245ab74-0540-435b-8e4f-6945f9578a5e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:59.619240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac4650-2bef-4b01-b07b-c9caa57fb86f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:59.628958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245ab74-0540-435b-8e4f-6945f9578a5e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:45:59.665275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0b86b-32b9-4ea3-a97e-a64584eab684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:59.665886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0b86b-32b9-4ea3-a97e-a64584eab684 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:59.666167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0b86b-32b9-4ea3-a97e-a64584eab684 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:59.666436 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0b86b-32b9-4ea3-a97e-a64584eab684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:59.670275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caad83-0742-48f2-8575-48c90b499dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:45:59.671091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caad83-0742-48f2-8575-48c90b499dca None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:45:59.671371 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caad83-0742-48f2-8575-48c90b499dca None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:45:59.671642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caad83-0742-48f2-8575-48c90b499dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:45:59.684148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:59.700966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:45:59.753884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caad83-0742-48f2-8575-48c90b499dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:59.755410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caad83-0742-48f2-8575-48c90b499dca None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:59.756312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0b86b-32b9-4ea3-a97e-a64584eab684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:45:59.758239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0b86b-32b9-4ea3-a97e-a64584eab684 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:45:59.929164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 90/181] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:45:59.936620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caad83-0742-48f2-8575-48c90b499dca None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:45:59.945406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 92/182] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:45:59.955861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0b86b-32b9-4ea3-a97e-a64584eab684 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:00.006633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:00.054546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:00.068227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0b86b-32b9-4ea3-a97e-a64584eab684 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:00.104104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121737f-7a65-4e15-9947-ad2a81e5108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:00.105607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121737f-7a65-4e15-9947-ad2a81e5108a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:00.105890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121737f-7a65-4e15-9947-ad2a81e5108a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:00.106158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121737f-7a65-4e15-9947-ad2a81e5108a None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:00.107327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121737f-7a65-4e15-9947-ad2a81e5108a None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:00.108752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121737f-7a65-4e15-9947-ad2a81e5108a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:00.111135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 93/183] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:59 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:00.117116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121737f-7a65-4e15-9947-ad2a81e5108a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:00.148743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caad83-0742-48f2-8575-48c90b499dca None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:00.186695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc678-0784-4506-b2ae-2d17f4116b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:00.187808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc678-0784-4506-b2ae-2d17f4116b1c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:00.188317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc678-0784-4506-b2ae-2d17f4116b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:00.188815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc678-0784-4506-b2ae-2d17f4116b1c None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:00.190596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fc678-0784-4506-b2ae-2d17f4116b1c None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:00.192382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fc678-0784-4506-b2ae-2d17f4116b1c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:00.194462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 91/184] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:45:59 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:00.200668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc678-0784-4506-b2ae-2d17f4116b1c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:00.239061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121737f-7a65-4e15-9947-ad2a81e5108a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:00.256526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:00.278333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ddf7-5534-46fc-831e-4f0229451e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:00.278972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ddf7-5534-46fc-831e-4f0229451e65 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:00.279252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ddf7-5534-46fc-831e-4f0229451e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:00.279523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ddf7-5534-46fc-831e-4f0229451e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:00.280251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049ddf7-5534-46fc-831e-4f0229451e65 None admin] RBAC: Adding query filter params (role.id=916b82353e034dbd9ae74f32d945ac09, scope.project.id=3404b245e3494ad0b5a108a32c6247e3, user.id=ca7b0998c27a4f2c859f2845411cebe4) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:00.280557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049ddf7-5534-46fc-831e-4f0229451e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:00.282212 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049ddf7-5534-46fc-831e-4f0229451e65 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:00.289712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 94/185] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:00 2022] GET /identity/v3/role_assignments?user.id=ca7b0998c27a4f2c859f2845411cebe4&scope.project.id=3404b245e3494ad0b5a108a32c6247e3&role.id=916b82353e034dbd9ae74f32d945ac09 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:00.370853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc678-0784-4506-b2ae-2d17f4116b1c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:00.401762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:00.426018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc3c69-53d6-4adc-98db-90a7fd3876f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:00.427041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3c69-53d6-4adc-98db-90a7fd3876f0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:00.427524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3c69-53d6-4adc-98db-90a7fd3876f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:00.427996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3c69-53d6-4adc-98db-90a7fd3876f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:00.428970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc3c69-53d6-4adc-98db-90a7fd3876f0 None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=3404b245e3494ad0b5a108a32c6247e3, user.id=ca7b0998c27a4f2c859f2845411cebe4) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:00.429494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc3c69-53d6-4adc-98db-90a7fd3876f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:00.431229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc3c69-53d6-4adc-98db-90a7fd3876f0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:00.438965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 92/186] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:00 2022] GET /identity/v3/role_assignments?user.id=ca7b0998c27a4f2c859f2845411cebe4&scope.project.id=3404b245e3494ad0b5a108a32c6247e3&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:01.169796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcce9-0114-45cc-8148-0d309f7e1afd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:01.170279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcce9-0114-45cc-8148-0d309f7e1afd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:01.170279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcce9-0114-45cc-8148-0d309f7e1afd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:01.171681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 95/187] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:01.176830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda90c-80c0-4762-9780-c888a3ab033e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:01.177229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda90c-80c0-4762-9780-c888a3ab033e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:01.177392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda90c-80c0-4762-9780-c888a3ab033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:01.196348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bdbda90c-80c0-4762-9780-c888a3ab033e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:01.197587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bdbda90c-80c0-4762-9780-c888a3ab033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:01.270082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 93/188] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:01.316338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ae82-4960-4a34-8914-00689aec62b4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:01.316650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ae82-4960-4a34-8914-00689aec62b4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:01.316902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ae82-4960-4a34-8914-00689aec62b4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:01.318376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 96/189] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:01.323374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1010b8-9544-4523-992f-3ddec5243c87 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:01.323667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1010b8-9544-4523-992f-3ddec5243c87 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:01.323942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1010b8-9544-4523-992f-3ddec5243c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:01.342282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7f1010b8-9544-4523-992f-3ddec5243c87 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:01.343498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7f1010b8-9544-4523-992f-3ddec5243c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:01.410553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 94/190] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:01.546034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ae82-4960-4a34-8914-00689aec62b4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:01.648650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ae82-4960-4a34-8914-00689aec62b4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:01.681929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c27ee-fb7b-4d5d-813e-68c3c944c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:01.682637 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c27ee-fb7b-4d5d-813e-68c3c944c4da None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:01.682919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c27ee-fb7b-4d5d-813e-68c3c944c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:01.683191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c27ee-fb7b-4d5d-813e-68c3c944c4da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:01.688067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1010b8-9544-4523-992f-3ddec5243c87 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:01.695347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c27ee-fb7b-4d5d-813e-68c3c944c4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c48c27ee-fb7b-4d5d-813e-68c3c944c4da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:01.700877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:01.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:01.702913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 97/191] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:01.710249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c27ee-fb7b-4d5d-813e-68c3c944c4da None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:01.740726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:01.758211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:01.796933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1010b8-9544-4523-992f-3ddec5243c87 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:01.825372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c27ee-fb7b-4d5d-813e-68c3c944c4da None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:01.833764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf384-9988-46a3-9500-bfd59e2972a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:01.834404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf384-9988-46a3-9500-bfd59e2972a6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:01.834719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf384-9988-46a3-9500-bfd59e2972a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:01.834994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf384-9988-46a3-9500-bfd59e2972a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:01.836107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cf384-9988-46a3-9500-bfd59e2972a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:01.837575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cf384-9988-46a3-9500-bfd59e2972a6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:01.839348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 95/192] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:01.844594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf384-9988-46a3-9500-bfd59e2972a6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:01.864713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:01.865452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:01.865732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:01.866123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:01.866851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:01.867160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:01.868579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:01.882711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 98/193] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:01.886705 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:01.957403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf384-9988-46a3-9500-bfd59e2972a6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:01.973457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:01.996418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819f5e8-a297-4ed7-9110-3c90ab845626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:01.997016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f5e8-a297-4ed7-9110-3c90ab845626 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:01.997292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f5e8-a297-4ed7-9110-3c90ab845626 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:01.997562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f5e8-a297-4ed7-9110-3c90ab845626 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:01.998209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819f5e8-a297-4ed7-9110-3c90ab845626 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:01.999669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819f5e8-a297-4ed7-9110-3c90ab845626 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:02.002080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:02.005005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc268ed-582a-4615-a0b1-bb8540b64888 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:02.022290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 96/194] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:46:01 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:46:02.023537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64d28-8ddc-4e76-8e45-be4b512fdc34 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:02.023818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64d28-8ddc-4e76-8e45-be4b512fdc34 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:02.024092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64d28-8ddc-4e76-8e45-be4b512fdc34 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:02.025321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 97/195] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:02.031143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a61c-159f-4697-9450-7af44d08c7a6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:02.031418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a61c-159f-4697-9450-7af44d08c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:02.031687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a61c-159f-4697-9450-7af44d08c7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:02.051181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c002a61c-159f-4697-9450-7af44d08c7a6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:02.052347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c002a61c-159f-4697-9450-7af44d08c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:02.057368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967efd19-37a0-4f91-856c-17bf182f8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:02.058023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967efd19-37a0-4f91-856c-17bf182f8eec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:02.058299 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967efd19-37a0-4f91-856c-17bf182f8eec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:02.058598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967efd19-37a0-4f91-856c-17bf182f8eec None admin] PATH_INFO: `/v3/users/86b8798d5efd46ba9d556c864afedfb4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:02.075906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967efd19-37a0-4f91-856c-17bf182f8eec None admin] RBAC: Authorizing `identity:get_user(user_id=86b8798d5efd46ba9d556c864afedfb4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:02.077403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967efd19-37a0-4f91-856c-17bf182f8eec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:02.080012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 99/196] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:01 2022] GET /identity/v3/users/86b8798d5efd46ba9d556c864afedfb4 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:02.085747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967efd19-37a0-4f91-856c-17bf182f8eec None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:02.134772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 98/197] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:02.204558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967efd19-37a0-4f91-856c-17bf182f8eec None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:02.240045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce012c-3f09-4d39-a73a-2b093d0bae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:02.240689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce012c-3f09-4d39-a73a-2b093d0bae2c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:02.240972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce012c-3f09-4d39-a73a-2b093d0bae2c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:02.241255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce012c-3f09-4d39-a73a-2b093d0bae2c None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:02.242437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce012c-3f09-4d39-a73a-2b093d0bae2c None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:02.243881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce012c-3f09-4d39-a73a-2b093d0bae2c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:02.245524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 100/198] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:46:02 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:02.252320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a61c-159f-4697-9450-7af44d08c7a6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:02.365603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:02.369401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a61c-159f-4697-9450-7af44d08c7a6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:02.416480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce012c-3f09-4d39-a73a-2b093d0bae2c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:02.416670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fc3f7-67cb-4e3a-938d-09e28f017f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:02.417683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fc3f7-67cb-4e3a-938d-09e28f017f51 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:02.418162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fc3f7-67cb-4e3a-938d-09e28f017f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:02.418646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fc3f7-67cb-4e3a-938d-09e28f017f51 None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3/users/86b8798d5efd46ba9d556c864afedfb4/roles/c481f43b9ca34894a93e66471cf203f2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:02.421879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fc3f7-67cb-4e3a-938d-09e28f017f51 None admin] RBAC: Authorizing `identity:create_grant(project_id=3404b245e3494ad0b5a108a32c6247e3, user_id=86b8798d5efd46ba9d556c864afedfb4, role_id=c481f43b9ca34894a93e66471cf203f2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:02.426433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fc3f7-67cb-4e3a-938d-09e28f017f51 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:02.446491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 99/199] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:02 2022] PUT /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3/users/86b8798d5efd46ba9d556c864afedfb4/roles/c481f43b9ca34894a93e66471cf203f2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:46:02.461642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:02.566841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce012c-3f09-4d39-a73a-2b093d0bae2c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:02.613413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cdac-fe77-4b7a-9e59-f8e007a43de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:02.614896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cdac-fe77-4b7a-9e59-f8e007a43de8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:02.615592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cdac-fe77-4b7a-9e59-f8e007a43de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:02.616298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cdac-fe77-4b7a-9e59-f8e007a43de8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:02.630805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128cdac-fe77-4b7a-9e59-f8e007a43de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7128cdac-fe77-4b7a-9e59-f8e007a43de8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:02.636164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:02.637266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:02.638281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:02.640001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 101/200] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:02.647444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fc3f7-67cb-4e3a-938d-09e28f017f51 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:02.772592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fc3f7-67cb-4e3a-938d-09e28f017f51 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:02.812293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:02.812919 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:02.813795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:02.814090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:02.814802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:02.815107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:02.816504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:02.825882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 100/201] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:02.833362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cdac-fe77-4b7a-9e59-f8e007a43de8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:02.941624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:02.961399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cdac-fe77-4b7a-9e59-f8e007a43de8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:03.008600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689969-fc3f-42ad-bf1b-87b07bcb1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:03.009244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689969-fc3f-42ad-bf1b-87b07bcb1d05 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:03.009526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689969-fc3f-42ad-bf1b-87b07bcb1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:03.009802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689969-fc3f-42ad-bf1b-87b07bcb1d05 None admin] PATH_INFO: `/v3/users/6b972287a3b3474a9e0e3956b444cea1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:03.011005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10689969-fc3f-42ad-bf1b-87b07bcb1d05 None admin] RBAC: Authorizing `identity:get_user(user_id=6b972287a3b3474a9e0e3956b444cea1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:03.012886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10689969-fc3f-42ad-bf1b-87b07bcb1d05 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:03.014748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 102/202] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:02 2022] GET /identity/v3/users/6b972287a3b3474a9e0e3956b444cea1 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:03.021136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:03.053101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:03.153248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095599-53b5-4c35-8d72-c145e45cc887 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:03.190614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002c0ba-0200-46bf-9d39-bcbc4fa62de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:03.191660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002c0ba-0200-46bf-9d39-bcbc4fa62de9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:03.192125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002c0ba-0200-46bf-9d39-bcbc4fa62de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:03.192580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002c0ba-0200-46bf-9d39-bcbc4fa62de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:03.269435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002c0ba-0200-46bf-9d39-bcbc4fa62de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:03.271713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002c0ba-0200-46bf-9d39-bcbc4fa62de9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:03.296594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:03.376577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 101/203] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:03.386565 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689969-fc3f-42ad-bf1b-87b07bcb1d05 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:03.495718 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689969-fc3f-42ad-bf1b-87b07bcb1d05 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:03.531123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ecfc8-8343-428a-9f98-12c404fc0c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:03.531758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecfc8-8343-428a-9f98-12c404fc0c28 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:03.532649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecfc8-8343-428a-9f98-12c404fc0c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:03.533076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecfc8-8343-428a-9f98-12c404fc0c28 None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:03.534323 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ecfc8-8343-428a-9f98-12c404fc0c28 None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:03.542542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ecfc8-8343-428a-9f98-12c404fc0c28 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:03.542542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 103/204] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:46:03 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:03.543514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002c0ba-0200-46bf-9d39-bcbc4fa62de9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:03.651654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002c0ba-0200-46bf-9d39-bcbc4fa62de9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:03.676167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:03.688340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d87ec9-199c-4d26-ab39-88bd65d41c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:03.689539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87ec9-199c-4d26-ab39-88bd65d41c49 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:03.689823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87ec9-199c-4d26-ab39-88bd65d41c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:03.690097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87ec9-199c-4d26-ab39-88bd65d41c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:03.690864 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d87ec9-199c-4d26-ab39-88bd65d41c49 None admin] RBAC: Adding query filter params (role.id=f9fed2e211414db0aa72e25fcc59d6f8, scope.project.id=3404b245e3494ad0b5a108a32c6247e3, user.id=6b972287a3b3474a9e0e3956b444cea1) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:03.691173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d87ec9-199c-4d26-ab39-88bd65d41c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:03.692613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d87ec9-199c-4d26-ab39-88bd65d41c49 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:03.698621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 102/205] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:03 2022] GET /identity/v3/role_assignments?user.id=6b972287a3b3474a9e0e3956b444cea1&scope.project.id=3404b245e3494ad0b5a108a32c6247e3&role.id=f9fed2e211414db0aa72e25fcc59d6f8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:04.512456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092956e-ca16-44af-8c54-b6acc97718f3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:04.512996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092956e-ca16-44af-8c54-b6acc97718f3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:04.512996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092956e-ca16-44af-8c54-b6acc97718f3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:04.514364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 104/206] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:04.519661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9aa5d-7c62-4275-aa5e-f412dd911069 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:04.520051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9aa5d-7c62-4275-aa5e-f412dd911069 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:04.520226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9aa5d-7c62-4275-aa5e-f412dd911069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:04.538806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-dfe9aa5d-7c62-4275-aa5e-f412dd911069 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:04.539964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dfe9aa5d-7c62-4275-aa5e-f412dd911069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:04.559646 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1935-8e20-4ea5-8c6b-d3c26bf2d0f7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:04.559939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1935-8e20-4ea5-8c6b-d3c26bf2d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:04.560216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1935-8e20-4ea5-8c6b-d3c26bf2d0f7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:04.561580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 105/207] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:04.566511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120a1d-8c98-4fa2-bbaa-487ba1583df0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:04.566834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120a1d-8c98-4fa2-bbaa-487ba1583df0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:04.567109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120a1d-8c98-4fa2-bbaa-487ba1583df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:04.587497 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8a120a1d-8c98-4fa2-bbaa-487ba1583df0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:04.588952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8a120a1d-8c98-4fa2-bbaa-487ba1583df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:04.608156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:04.615833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 103/208] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:04.663354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 106/209] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:04.774477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc18e-6b84-457a-a2f4-312ec7722ed2 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:04.774791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc18e-6b84-457a-a2f4-312ec7722ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:04.774997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc18e-6b84-457a-a2f4-312ec7722ed2 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:04.776485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 104/210] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:04.781668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b82b6-f10a-4636-b45e-8fbac65718f5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:04.781960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b82b6-f10a-4636-b45e-8fbac65718f5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:04.782234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b82b6-f10a-4636-b45e-8fbac65718f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:04.801632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9b8b82b6-f10a-4636-b45e-8fbac65718f5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:04.802838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9b8b82b6-f10a-4636-b45e-8fbac65718f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:04.869367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 107/211] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:04.885531 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc18e-6b84-457a-a2f4-312ec7722ed2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:04.936817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b82b6-f10a-4636-b45e-8fbac65718f5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:04.992528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc18e-6b84-457a-a2f4-312ec7722ed2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.010271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:05.030215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e1903-f824-46e4-a5dd-903a87546a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.030814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1903-f824-46e4-a5dd-903a87546a71 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.030950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:05.031084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1903-f824-46e4-a5dd-903a87546a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.031358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1903-f824-46e4-a5dd-903a87546a71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.042359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e1903-f824-46e4-a5dd-903a87546a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-975e1903-f824-46e4-a5dd-903a87546a71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:05.047207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:05.048632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:05.051226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 105/212] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:05.054366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b82b6-f10a-4636-b45e-8fbac65718f5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.054625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e1903-f824-46e4-a5dd-903a87546a71 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:05.089348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815aadd-53ad-4493-8b36-863bdee7d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.089978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815aadd-53ad-4493-8b36-863bdee7d639 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.090255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815aadd-53ad-4493-8b36-863bdee7d639 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.090562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815aadd-53ad-4493-8b36-863bdee7d639 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.091783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815aadd-53ad-4493-8b36-863bdee7d639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:05.093291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815aadd-53ad-4493-8b36-863bdee7d639 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:05.095610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 108/213] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:05.100684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815aadd-53ad-4493-8b36-863bdee7d639 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:05.162654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e1903-f824-46e4-a5dd-903a87546a71 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.197178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.197782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.198054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.198324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.199012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:05.199311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:05.200671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:05.202203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815aadd-53ad-4493-8b36-863bdee7d639 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.209048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 106/214] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:05.209822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:05.237029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ae1b0-2978-460c-9bd9-e130a49d4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.237641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ae1b0-2978-460c-9bd9-e130a49d4dec None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.237918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ae1b0-2978-460c-9bd9-e130a49d4dec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.238197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ae1b0-2978-460c-9bd9-e130a49d4dec None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.238888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ae1b0-2978-460c-9bd9-e130a49d4dec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:05.240317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ae1b0-2978-460c-9bd9-e130a49d4dec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:05.252200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:05.261728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 109/215] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:46:05 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:46:05.263592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ae1b0-2978-460c-9bd9-e130a49d4dec None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:05.277033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:05.322423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6d2d2-8b56-4620-a1db-01c4ca4775ee None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.359405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec68e6-2490-4139-aa24-1fcca9c722d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.360413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec68e6-2490-4139-aa24-1fcca9c722d6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.360868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec68e6-2490-4139-aa24-1fcca9c722d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.361286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec68e6-2490-4139-aa24-1fcca9c722d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.372994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec68e6-2490-4139-aa24-1fcca9c722d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-34ec68e6-2490-4139-aa24-1fcca9c722d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:05.379972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:05.381136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:05.382116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:05.384179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 107/216] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:05.389156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ae1b0-2978-460c-9bd9-e130a49d4dec None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.390273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec68e6-2490-4139-aa24-1fcca9c722d6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:05.427552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef018b7e-1f15-4918-ba66-1418ebd3bd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.428203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018b7e-1f15-4918-ba66-1418ebd3bd73 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.428484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018b7e-1f15-4918-ba66-1418ebd3bd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.428758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018b7e-1f15-4918-ba66-1418ebd3bd73 None admin] PATH_INFO: `/v3/users/073605034e3048efa1aee54ac8c42edf` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.443857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef018b7e-1f15-4918-ba66-1418ebd3bd73 None admin] RBAC: Authorizing `identity:get_user(user_id=073605034e3048efa1aee54ac8c42edf)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:05.445734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef018b7e-1f15-4918-ba66-1418ebd3bd73 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:05.447484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 110/217] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:05 2022] GET /identity/v3/users/073605034e3048efa1aee54ac8c42edf => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:05.453413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef018b7e-1f15-4918-ba66-1418ebd3bd73 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:05.507714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:05.509785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec68e6-2490-4139-aa24-1fcca9c722d6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.530227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:05.557326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.558006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.558220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.558493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.559214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:05.559517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:05.561085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:05.573506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 108/218] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:05.580981 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:05.581683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef018b7e-1f15-4918-ba66-1418ebd3bd73 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.626165 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.627119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.627399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.627672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.629452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] RBAC: Adding query filter params (role.id=f9fed2e211414db0aa72e25fcc59d6f8, user.id=073605034e3048efa1aee54ac8c42edf, scope.system=all) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:05.629452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:05.630317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:05.636311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 111/219] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Oct 10 16:46:05 2022] GET /identity/v3/role_assignments?user.id=073605034e3048efa1aee54ac8c42edf&scope.system=all&role.id=f9fed2e211414db0aa72e25fcc59d6f8 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:05.703112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64868-a527-42ec-8385-725f8720e751 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.744332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6bb1d-b4ce-4a7c-b101-067603930256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.744979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bb1d-b4ce-4a7c-b101-067603930256 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.745323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bb1d-b4ce-4a7c-b101-067603930256 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.745603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bb1d-b4ce-4a7c-b101-067603930256 None admin] PATH_INFO: `/v3/users/86b8798d5efd46ba9d556c864afedfb4` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.746843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6bb1d-b4ce-4a7c-b101-067603930256 None admin] RBAC: Authorizing `identity:get_user(user_id=86b8798d5efd46ba9d556c864afedfb4)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:05.748335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6bb1d-b4ce-4a7c-b101-067603930256 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:05.750017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 109/220] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:05 2022] GET /identity/v3/users/86b8798d5efd46ba9d556c864afedfb4 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:05.756933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:05.870799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da0e37-a7fc-46d4-9a4f-c33f40470325 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:05.900892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:05.909639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde4fe-a41f-4365-89b7-ad76c48e91e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:05.910251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde4fe-a41f-4365-89b7-ad76c48e91e8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:05.910562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde4fe-a41f-4365-89b7-ad76c48e91e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:05.910822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde4fe-a41f-4365-89b7-ad76c48e91e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:05.983494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde4fe-a41f-4365-89b7-ad76c48e91e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:05.984989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde4fe-a41f-4365-89b7-ad76c48e91e8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:06.085603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 112/221] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:06.091296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6bb1d-b4ce-4a7c-b101-067603930256 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:06.122450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:06.200683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6bb1d-b4ce-4a7c-b101-067603930256 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:06.238278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95057f69-fc3c-49fb-8ce4-9045cc7c19b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:06.238941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95057f69-fc3c-49fb-8ce4-9045cc7c19b8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:06.239224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95057f69-fc3c-49fb-8ce4-9045cc7c19b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:06.239498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95057f69-fc3c-49fb-8ce4-9045cc7c19b8 None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:06.240627 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95057f69-fc3c-49fb-8ce4-9045cc7c19b8 None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:06.242134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95057f69-fc3c-49fb-8ce4-9045cc7c19b8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:06.243889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 110/222] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:46:06 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:06.249758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde4fe-a41f-4365-89b7-ad76c48e91e8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:06.283919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:06.362927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde4fe-a41f-4365-89b7-ad76c48e91e8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:06.405493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61aaab-733c-4d88-baea-a4d93eb5d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:06.406116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61aaab-733c-4d88-baea-a4d93eb5d8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:06.406714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61aaab-733c-4d88-baea-a4d93eb5d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:06.407550 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61aaab-733c-4d88-baea-a4d93eb5d8c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:06.408913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61aaab-733c-4d88-baea-a4d93eb5d8c7 None admin] RBAC: Adding query filter params (role.id=c481f43b9ca34894a93e66471cf203f2, scope.project.id=3404b245e3494ad0b5a108a32c6247e3, user.id=86b8798d5efd46ba9d556c864afedfb4) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:06.409226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61aaab-733c-4d88-baea-a4d93eb5d8c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:06.410689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61aaab-733c-4d88-baea-a4d93eb5d8c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:06.416990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 113/223] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:06 2022] GET /identity/v3/role_assignments?user.id=86b8798d5efd46ba9d556c864afedfb4&scope.project.id=3404b245e3494ad0b5a108a32c6247e3&role.id=c481f43b9ca34894a93e66471cf203f2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:07.680588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22894a-1bbb-4e31-92f1-3db53d2fd3bc None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:07.681293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22894a-1bbb-4e31-92f1-3db53d2fd3bc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:07.681293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22894a-1bbb-4e31-92f1-3db53d2fd3bc None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:07.682608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 111/224] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:07.683188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709baa6d-3b38-4da9-89c8-4affbf486163 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:07.683716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709baa6d-3b38-4da9-89c8-4affbf486163 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:07.683821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709baa6d-3b38-4da9-89c8-4affbf486163 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:07.685226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 114/225] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:07.687333 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895440-a77d-4343-a814-a6cc2a7752c0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:07.687614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895440-a77d-4343-a814-a6cc2a7752c0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:07.687881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895440-a77d-4343-a814-a6cc2a7752c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:07.690880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef8da-9303-43cb-b6ce-71435562b5bc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:07.691171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef8da-9303-43cb-b6ce-71435562b5bc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:07.691449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef8da-9303-43cb-b6ce-71435562b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:07.708916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-51895440-a77d-4343-a814-a6cc2a7752c0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:07.709096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3afef8da-9303-43cb-b6ce-71435562b5bc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:07.710128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3afef8da-9303-43cb-b6ce-71435562b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:07.710560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-51895440-a77d-4343-a814-a6cc2a7752c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:07.786895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 115/226] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:07.794643 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 112/227] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:07.856156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadba41-e1a0-47f5-abd8-2fe46fb862c6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:07.856442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadba41-e1a0-47f5-abd8-2fe46fb862c6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:07.856723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadba41-e1a0-47f5-abd8-2fe46fb862c6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:07.858221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 116/228] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:07.863718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f5bb-4e0b-48da-b589-3669b71aed23 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:07.864008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f5bb-4e0b-48da-b589-3669b71aed23 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:07.864282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f5bb-4e0b-48da-b589-3669b71aed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:07.886726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ad93f5bb-4e0b-48da-b589-3669b71aed23 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:07.887920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ad93f5bb-4e0b-48da-b589-3669b71aed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:07.909710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:07.958264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 113/229] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:08.057099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadba41-e1a0-47f5-abd8-2fe46fb862c6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.057601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f5bb-4e0b-48da-b589-3669b71aed23 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.082280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:08.165104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadba41-e1a0-47f5-abd8-2fe46fb862c6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.171696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f5bb-4e0b-48da-b589-3669b71aed23 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.202053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584411df-f7c5-47de-8ea5-3bda0eba4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.203130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584411df-f7c5-47de-8ea5-3bda0eba4af2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.203820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584411df-f7c5-47de-8ea5-3bda0eba4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.204701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584411df-f7c5-47de-8ea5-3bda0eba4af2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.206175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584411df-f7c5-47de-8ea5-3bda0eba4af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:08.208014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584411df-f7c5-47de-8ea5-3bda0eba4af2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:08.208252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923a5b5-8757-4a2e-bbfb-3d1579679a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.208933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a5b5-8757-4a2e-bbfb-3d1579679a7c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.209146 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a5b5-8757-4a2e-bbfb-3d1579679a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.209415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a5b5-8757-4a2e-bbfb-3d1579679a7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.211206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 117/230] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:08.216398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584411df-f7c5-47de-8ea5-3bda0eba4af2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.223935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923a5b5-8757-4a2e-bbfb-3d1579679a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6923a5b5-8757-4a2e-bbfb-3d1579679a7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:08.228768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:08.229656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:08.230433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:08.234509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 114/231] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:08.235380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923a5b5-8757-4a2e-bbfb-3d1579679a7c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.253809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:08.310734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:08.321420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584411df-f7c5-47de-8ea5-3bda0eba4af2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.333267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923a5b5-8757-4a2e-bbfb-3d1579679a7c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.355384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2191d2-7148-4022-96c8-5eb4b766acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.355986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2191d2-7148-4022-96c8-5eb4b766acfa None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.356263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2191d2-7148-4022-96c8-5eb4b766acfa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.356535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2191d2-7148-4022-96c8-5eb4b766acfa None admin] PATH_INFO: `/v3/groups` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.357164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2191d2-7148-4022-96c8-5eb4b766acfa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:08.358620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2191d2-7148-4022-96c8-5eb4b766acfa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:08.365847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797cf71-4020-499c-aee3-b8ba218c736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.366671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797cf71-4020-499c-aee3-b8ba218c736e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.366946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797cf71-4020-499c-aee3-b8ba218c736e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.367213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797cf71-4020-499c-aee3-b8ba218c736e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.386783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 118/232] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Oct 10 16:46:08 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:08.387016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797cf71-4020-499c-aee3-b8ba218c736e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:08.387100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2191d2-7148-4022-96c8-5eb4b766acfa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-9797cf71-4020-499c-aee3-b8ba218c736e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:08.387180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:08.387983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:08.388766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 115/233] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:08.399860 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797cf71-4020-499c-aee3-b8ba218c736e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.495373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:08.514841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2191d2-7148-4022-96c8-5eb4b766acfa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.523805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797cf71-4020-499c-aee3-b8ba218c736e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.554852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.555476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.555756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.556027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.556706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:08.557010 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:08.558376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:08.561234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.561841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.562126 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.562402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.563735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:08.564058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:08.565430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:08.568286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 119/234] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:08.574025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.575075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 116/235] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:08.580517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.591758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:08.691761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f19b0-7824-457c-bd39-edb1970d179f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.694503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6aa6-1c5a-4848-a677-10d1e938bad1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.729965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82d6ef-a2b6-41da-ae9f-089fe336293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.730623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82d6ef-a2b6-41da-ae9f-089fe336293c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.730874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82d6ef-a2b6-41da-ae9f-089fe336293c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.731148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82d6ef-a2b6-41da-ae9f-089fe336293c None admin] PATH_INFO: `/v3/users/073605034e3048efa1aee54ac8c42edf` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.732281 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82d6ef-a2b6-41da-ae9f-089fe336293c None admin] RBAC: Authorizing `identity:get_user(user_id=073605034e3048efa1aee54ac8c42edf)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:08.733738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82d6ef-a2b6-41da-ae9f-089fe336293c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:08.734325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517767be-68bb-4dd1-8ca9-4ffee0cfd934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.735760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517767be-68bb-4dd1-8ca9-4ffee0cfd934 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.735875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 117/236] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:08 2022] GET /identity/v3/users/073605034e3048efa1aee54ac8c42edf => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:08.736524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517767be-68bb-4dd1-8ca9-4ffee0cfd934 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.736946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517767be-68bb-4dd1-8ca9-4ffee0cfd934 None admin] PATH_INFO: `/v3/users/b80a5dda28ed4bac924ed2bc83cc3191` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.741721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82d6ef-a2b6-41da-ae9f-089fe336293c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.750995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:08.752775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517767be-68bb-4dd1-8ca9-4ffee0cfd934 None admin] RBAC: Authorizing `identity:get_user(user_id=b80a5dda28ed4bac924ed2bc83cc3191)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:08.754857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517767be-68bb-4dd1-8ca9-4ffee0cfd934 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:08.757343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 120/237] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:08 2022] GET /identity/v3/users/b80a5dda28ed4bac924ed2bc83cc3191 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:08.763376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517767be-68bb-4dd1-8ca9-4ffee0cfd934 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:08.844837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:08.847435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82d6ef-a2b6-41da-ae9f-089fe336293c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.879446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517767be-68bb-4dd1-8ca9-4ffee0cfd934 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:08.885653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528ec86-a595-4741-b30c-fb5cbe9f9f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.885653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ec86-a595-4741-b30c-fb5cbe9f9f7e None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.885653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ec86-a595-4741-b30c-fb5cbe9f9f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.885653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ec86-a595-4741-b30c-fb5cbe9f9f7e None admin] PATH_INFO: `/v3/system/users/073605034e3048efa1aee54ac8c42edf/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.886590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528ec86-a595-4741-b30c-fb5cbe9f9f7e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=073605034e3048efa1aee54ac8c42edf, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:08.888064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528ec86-a595-4741-b30c-fb5cbe9f9f7e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:08.901432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 118/238] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Oct 10 16:46:08 2022] PUT /identity/v3/system/users/073605034e3048efa1aee54ac8c42edf/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:46:08.924059 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee97bda-5e40-4c1f-b75f-24cad468eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:08.924696 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97bda-5e40-4c1f-b75f-24cad468eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:08.924980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97bda-5e40-4c1f-b75f-24cad468eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:08.925257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97bda-5e40-4c1f-b75f-24cad468eaa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:08.926088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee97bda-5e40-4c1f-b75f-24cad468eaa2 None admin] RBAC: Adding query filter params (role.id=c481f43b9ca34894a93e66471cf203f2, user.id=b80a5dda28ed4bac924ed2bc83cc3191, scope.system=all) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:08.926407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee97bda-5e40-4c1f-b75f-24cad468eaa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:08.927954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee97bda-5e40-4c1f-b75f-24cad468eaa2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:08.935095 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 121/239] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Oct 10 16:46:08 2022] GET /identity/v3/role_assignments?user.id=b80a5dda28ed4bac924ed2bc83cc3191&scope.system=all&role.id=c481f43b9ca34894a93e66471cf203f2 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:10.592880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547f2d-3f73-428a-ba23-e1b283591c0c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:10.593405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547f2d-3f73-428a-ba23-e1b283591c0c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:10.593482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547f2d-3f73-428a-ba23-e1b283591c0c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:10.595768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 119/240] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:10.600944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b6f23-c5b4-40db-9f46-1c05757a5e53 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:10.601360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b6f23-c5b4-40db-9f46-1c05757a5e53 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:10.601524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b6f23-c5b4-40db-9f46-1c05757a5e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:10.620546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d23b6f23-c5b4-40db-9f46-1c05757a5e53 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:10.621744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d23b6f23-c5b4-40db-9f46-1c05757a5e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:10.694054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 122/241] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:10.963885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc547f2d-3f73-428a-ba23-e1b283591c0c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:11.038486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:11.066328 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad46b-217c-4aba-801d-a2b8d7d210d6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.066643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad46b-217c-4aba-801d-a2b8d7d210d6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.066925 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ad46b-217c-4aba-801d-a2b8d7d210d6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.068440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 123/242] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:11.073261 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a403c3-f9c2-42d8-87dd-3d71adc33586 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.073552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a403c3-f9c2-42d8-87dd-3d71adc33586 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.073919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a403c3-f9c2-42d8-87dd-3d71adc33586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.075387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc547f2d-3f73-428a-ba23-e1b283591c0c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:11.091384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a8a403c3-f9c2-42d8-87dd-3d71adc33586 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:11.092572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a8a403c3-f9c2-42d8-87dd-3d71adc33586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:11.108463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4274-6871-4517-a206-a89e1b6a823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:11.109083 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4274-6871-4517-a206-a89e1b6a823b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.109361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4274-6871-4517-a206-a89e1b6a823b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.109633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4274-6871-4517-a206-a89e1b6a823b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.111516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4274-6871-4517-a206-a89e1b6a823b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:11.112960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4274-6871-4517-a206-a89e1b6a823b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:11.114737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 120/243] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:11.115611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edae36-6277-4a81-99e0-5d8ebb3eee31 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.115889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edae36-6277-4a81-99e0-5d8ebb3eee31 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.116161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edae36-6277-4a81-99e0-5d8ebb3eee31 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.117490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 121/244] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:11.119838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edae36-6277-4a81-99e0-5d8ebb3eee31 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:11.152737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:11.162968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 124/245] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:11.164192 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5196-addc-41b5-bcbe-0c482ded9776 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.164477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5196-addc-41b5-bcbe-0c482ded9776 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.164748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5196-addc-41b5-bcbe-0c482ded9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.182228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ddde5196-addc-41b5-bcbe-0c482ded9776 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:11.183432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ddde5196-addc-41b5-bcbe-0c482ded9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:11.225428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edae36-6277-4a81-99e0-5d8ebb3eee31 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:11.254564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 125/246] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:11.272268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783049-d419-4d32-bd3d-fda390064efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:11.272880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783049-d419-4d32-bd3d-fda390064efc None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.273160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783049-d419-4d32-bd3d-fda390064efc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.273433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783049-d419-4d32-bd3d-fda390064efc None admin] PATH_INFO: `/v3/groups` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.274069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0783049-d419-4d32-bd3d-fda390064efc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:11.275538 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0783049-d419-4d32-bd3d-fda390064efc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:11.289765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:11.295973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 122/247] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Oct 10 16:46:11 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:46:11.445965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5196-addc-41b5-bcbe-0c482ded9776 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:11.541246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783049-d419-4d32-bd3d-fda390064efc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:11.562980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5196-addc-41b5-bcbe-0c482ded9776 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:11.593229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:11.608916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9133-2140-431c-b69e-ecb8e6e7e535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:11.609549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9133-2140-431c-b69e-ecb8e6e7e535 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.609826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9133-2140-431c-b69e-ecb8e6e7e535 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.610109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee9133-2140-431c-b69e-ecb8e6e7e535 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.622367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee9133-2140-431c-b69e-ecb8e6e7e535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-dbee9133-2140-431c-b69e-ecb8e6e7e535 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:11.627908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:11.628793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:11.629570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 126/248] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:11.635915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9133-2140-431c-b69e-ecb8e6e7e535 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:11.690849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783049-d419-4d32-bd3d-fda390064efc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:11.738054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5fad0-0d08-48c1-b0b4-123a1752be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:11.738694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5fad0-0d08-48c1-b0b4-123a1752be75 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.738970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5fad0-0d08-48c1-b0b4-123a1752be75 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.739240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5fad0-0d08-48c1-b0b4-123a1752be75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.754017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5fad0-0d08-48c1-b0b4-123a1752be75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-c8a5fad0-0d08-48c1-b0b4-123a1752be75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:11.761272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:11.762180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:11.763020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 123/249] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:11.769228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5fad0-0d08-48c1-b0b4-123a1752be75 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:11.772679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee9133-2140-431c-b69e-ecb8e6e7e535 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:11.818548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:11.819166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.819444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.819714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.820389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:11.820681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:11.822047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:11.831342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 127/250] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:11.840221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:11.856348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:11.899089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:11.922197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5fad0-0d08-48c1-b0b4-123a1752be75 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:11.969963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:11.970998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:11.971552 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:11.972019 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:11.973504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:11.974234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:11.975845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:11.976250 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71a64-845a-40a7-ab6d-ab63dc0d9019 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:11.988714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 124/251] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:11.994657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:12.023992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768398f9-5281-47af-b371-a15a1ac17b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:12.024623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768398f9-5281-47af-b371-a15a1ac17b64 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:12.024900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768398f9-5281-47af-b371-a15a1ac17b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:12.025173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768398f9-5281-47af-b371-a15a1ac17b64 None admin] PATH_INFO: `/v3/users/073605034e3048efa1aee54ac8c42edf` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:12.026367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768398f9-5281-47af-b371-a15a1ac17b64 None admin] RBAC: Authorizing `identity:get_user(user_id=073605034e3048efa1aee54ac8c42edf)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:12.028012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768398f9-5281-47af-b371-a15a1ac17b64 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:12.029909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 128/252] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:11 2022] GET /identity/v3/users/073605034e3048efa1aee54ac8c42edf => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:12.035521 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768398f9-5281-47af-b371-a15a1ac17b64 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:12.131279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f2ce-37fb-403d-b1d8-7d66e7dabf9f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:12.159444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:12.182024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768398f9-5281-47af-b371-a15a1ac17b64 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:12.183980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d3a3-3286-4492-847a-00d7d2e67351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:12.184910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d3a3-3286-4492-847a-00d7d2e67351 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:12.185414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d3a3-3286-4492-847a-00d7d2e67351 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:12.185906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d3a3-3286-4492-847a-00d7d2e67351 None admin] PATH_INFO: `/v3/users/b80a5dda28ed4bac924ed2bc83cc3191` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:12.187456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1d3a3-3286-4492-847a-00d7d2e67351 None admin] RBAC: Authorizing `identity:get_user(user_id=b80a5dda28ed4bac924ed2bc83cc3191)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:12.190249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1d3a3-3286-4492-847a-00d7d2e67351 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:12.192416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 125/253] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:11 2022] GET /identity/v3/users/b80a5dda28ed4bac924ed2bc83cc3191 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:12.198403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d3a3-3286-4492-847a-00d7d2e67351 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:12.204109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:12.235207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ad1b-ef2c-4d7d-906b-2bcec486c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:12.235916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ad1b-ef2c-4d7d-906b-2bcec486c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:12.236274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ad1b-ef2c-4d7d-906b-2bcec486c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:12.236619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ad1b-ef2c-4d7d-906b-2bcec486c7f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:12.237430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ad1b-ef2c-4d7d-906b-2bcec486c7f6 None admin] RBAC: Adding query filter params (role.id=f9fed2e211414db0aa72e25fcc59d6f8, user.id=073605034e3048efa1aee54ac8c42edf, scope.system=all) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:12.237902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ad1b-ef2c-4d7d-906b-2bcec486c7f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:12.239519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ad1b-ef2c-4d7d-906b-2bcec486c7f6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:12.255305 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 129/254] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Oct 10 16:46:12 2022] GET /identity/v3/role_assignments?user.id=073605034e3048efa1aee54ac8c42edf&scope.system=all&role.id=f9fed2e211414db0aa72e25fcc59d6f8 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:12.341248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d3a3-3286-4492-847a-00d7d2e67351 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:12.387447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a633573-1e41-42dd-8b2e-185fc509cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:12.388540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a633573-1e41-42dd-8b2e-185fc509cdb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:12.389012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a633573-1e41-42dd-8b2e-185fc509cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:12.389470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a633573-1e41-42dd-8b2e-185fc509cdb5 None admin] PATH_INFO: `/v3/system/users/b80a5dda28ed4bac924ed2bc83cc3191/roles/c481f43b9ca34894a93e66471cf203f2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:12.395524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a633573-1e41-42dd-8b2e-185fc509cdb5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b80a5dda28ed4bac924ed2bc83cc3191, role_id=c481f43b9ca34894a93e66471cf203f2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:12.397326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a633573-1e41-42dd-8b2e-185fc509cdb5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:12.413028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 126/255] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Oct 10 16:46:12 2022] PUT /identity/v3/system/users/b80a5dda28ed4bac924ed2bc83cc3191/roles/c481f43b9ca34894a93e66471cf203f2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:46:14.076713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636d65-2af7-4dc6-91d2-a5ed25f74c37 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.077209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636d65-2af7-4dc6-91d2-a5ed25f74c37 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.077381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636d65-2af7-4dc6-91d2-a5ed25f74c37 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.079177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 130/256] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:14.084647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209999-deb7-4d6f-8b8c-c4ed9dbdefd3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.085494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209999-deb7-4d6f-8b8c-c4ed9dbdefd3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.085972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209999-deb7-4d6f-8b8c-c4ed9dbdefd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.111339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-53209999-deb7-4d6f-8b8c-c4ed9dbdefd3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:14.112873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-53209999-deb7-4d6f-8b8c-c4ed9dbdefd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:14.181721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:14.193586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 127/257] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 10 16:46:14.395457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe5270-07c0-4c87-8c6f-fa15e2694893 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.395818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe5270-07c0-4c87-8c6f-fa15e2694893 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.396014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe5270-07c0-4c87-8c6f-fa15e2694893 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.397868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 131/258] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:14.403240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356031-a14e-4bdc-ab70-9a516a1f105c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.403776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356031-a14e-4bdc-ab70-9a516a1f105c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.404250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356031-a14e-4bdc-ab70-9a516a1f105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.428609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-43356031-a14e-4bdc-ab70-9a516a1f105c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:14.430151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-43356031-a14e-4bdc-ab70-9a516a1f105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:14.446199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 128/259] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 10 16:46:14.677813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe5270-07c0-4c87-8c6f-fa15e2694893 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:14.692126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe5270-07c0-4c87-8c6f-fa15e2694893 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:14.698884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125efe76-f43e-4784-a113-4c6b04d7ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:14.699458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125efe76-f43e-4784-a113-4c6b04d7ee14 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.699736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125efe76-f43e-4784-a113-4c6b04d7ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.700005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125efe76-f43e-4784-a113-4c6b04d7ee14 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.720210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125efe76-f43e-4784-a113-4c6b04d7ee14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-125efe76-f43e-4784-a113-4c6b04d7ee14 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:14.725052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:14.725924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:14.726755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 132/260] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Oct 10 16:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:14.732099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356031-a14e-4bdc-ab70-9a516a1f105c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:14.746963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356031-a14e-4bdc-ab70-9a516a1f105c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:14.754392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043090b-5130-4644-9b78-cfc33be7fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:14.755296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043090b-5130-4644-9b78-cfc33be7fa36 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.755779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043090b-5130-4644-9b78-cfc33be7fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.756254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043090b-5130-4644-9b78-cfc33be7fa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.757120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043090b-5130-4644-9b78-cfc33be7fa36 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:14.757677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043090b-5130-4644-9b78-cfc33be7fa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:14.759870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-b043090b-5130-4644-9b78-cfc33be7fa36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:46:14.759870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:46:14.759870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:46:14.761179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043090b-5130-4644-9b78-cfc33be7fa36 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:14.775510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 129/261] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:46:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:14.780872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125efe76-f43e-4784-a113-4c6b04d7ee14 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:14.795785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125efe76-f43e-4784-a113-4c6b04d7ee14 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:14.806919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:14.807560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.807839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.808111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] PATH_INFO: `/v3/groups/50eca21cbf914262a17b18d5a8ae6efa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.820257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9fed8-d3f5-415d-be9c-e4b6bc19c5c5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.820979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9fed8-d3f5-415d-be9c-e4b6bc19c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.821575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9fed8-d3f5-415d-be9c-e4b6bc19c5c5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.821864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] RBAC: Authorizing `identity:get_group(group_id=50eca21cbf914262a17b18d5a8ae6efa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:14.823726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:46:14.823726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 10 16:46:14.823726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: Oct 10 16:46:14.824075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 130/262] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:14.824967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:14.826758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 133/263] 10.222.0.27 () {56 vars in 1201 bytes} [Mon Oct 10 16:46:14 2022] GET /identity/v3/groups/50eca21cbf914262a17b18d5a8ae6efa => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:14.828902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9fed8-d3f5-415d-be9c-e4b6bc19c5c5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:14.832812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:14.847130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9fed8-d3f5-415d-be9c-e4b6bc19c5c5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:14.851544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337b6b9-b13c-48e4-8393-333b2d969af5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:14.852408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f400bf-cc49-48b6-8b67-d95bc3c8c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:14.853650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f400bf-cc49-48b6-8b67-d95bc3c8c736 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.854222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f400bf-cc49-48b6-8b67-d95bc3c8c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.854783 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f400bf-cc49-48b6-8b67-d95bc3c8c736 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.862371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc826a-f8c8-49e7-af37-a7267679309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:14.865445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc826a-f8c8-49e7-af37-a7267679309a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.865445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc826a-f8c8-49e7-af37-a7267679309a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.865445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc826a-f8c8-49e7-af37-a7267679309a admin admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.868378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc826a-f8c8-49e7-af37-a7267679309a admin admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:14.870643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc826a-f8c8-49e7-af37-a7267679309a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:14.871710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f400bf-cc49-48b6-8b67-d95bc3c8c736 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:14.872448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 134/264] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Oct 10 16:46:14 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:14.873578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91522a4-bc0c-4bb4-a508-ce6117500754 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.873920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91522a4-bc0c-4bb4-a508-ce6117500754 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.874195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91522a4-bc0c-4bb4-a508-ce6117500754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-39f400bf-cc49-48b6-8b67-d95bc3c8c736 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:14.885006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:14.885951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:14.886767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:14.894815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 131/265] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Oct 10 16:46:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:14.896253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f400bf-cc49-48b6-8b67-d95bc3c8c736 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:14.911415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f400bf-cc49-48b6-8b67-d95bc3c8c736 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:14.916523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:14.916791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b91522a4-bc0c-4bb4-a508-ce6117500754 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:14.917736 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:14.917948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b91522a4-bc0c-4bb4-a508-ce6117500754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:14.918559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:14.919044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff/groups/50eca21cbf914262a17b18d5a8ae6efa/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:14.921457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b218b47344fc483aafd8820bac65f2ff, group_id=50eca21cbf914262a17b18d5a8ae6efa, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:14.923670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:46:14.923670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:46:14.923670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:46:14.926506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:14.939880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 135/266] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 10 16:46:14.943005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91522a4-bc0c-4bb4-a508-ce6117500754 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:14.955666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 132/267] 10.222.0.27 () {58 vars in 1463 bytes} [Mon Oct 10 16:46:14 2022] PUT /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff/groups/50eca21cbf914262a17b18d5a8ae6efa/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:14.961924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91522a4-bc0c-4bb4-a508-ce6117500754 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.034291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.035408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.035897 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.036432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.037451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:15.037768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:15.038942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:46:15.038942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 10 16:46:15.038942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: Oct 10 16:46:15.039971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:15.051153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 136/268] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Oct 10 16:46:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:15.056889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:15.068755 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98327f8-d8da-4ceb-94da-6e7469000f97 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.073693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.074386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.074784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.075197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] PATH_INFO: `/v3/groups/50eca21cbf914262a17b18d5a8ae6efa` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.076381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] RBAC: Authorizing `identity:get_group(group_id=50eca21cbf914262a17b18d5a8ae6efa)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:15.077474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:46:15.077474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:46:15.077474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:46:15.078871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:15.081230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 133/269] 10.222.0.27 () {56 vars in 1201 bytes} [Mon Oct 10 16:46:15 2022] GET /identity/v3/groups/50eca21cbf914262a17b18d5a8ae6efa => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:15.086470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:15.098389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361c48-ca89-4199-9203-5121cf209456 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.106017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b424812-f796-4068-810a-22f794ded7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.106741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b424812-f796-4068-810a-22f794ded7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.107027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b424812-f796-4068-810a-22f794ded7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.107362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b424812-f796-4068-810a-22f794ded7ad admin admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.108635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b424812-f796-4068-810a-22f794ded7ad admin admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:15.111841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b424812-f796-4068-810a-22f794ded7ad admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:15.113657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 137/270] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Oct 10 16:46:15 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:15.119684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:15.131697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b60dd9-3a6c-4c88-b408-5e9597c6c7d8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.140036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d01b4-4d31-40fd-a6c3-a95f5bde9bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.140838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d01b4-4d31-40fd-a6c3-a95f5bde9bac admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.141841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d01b4-4d31-40fd-a6c3-a95f5bde9bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.142125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d01b4-4d31-40fd-a6c3-a95f5bde9bac admin admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff/groups/50eca21cbf914262a17b18d5a8ae6efa/roles/916b82353e034dbd9ae74f32d945ac09` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.144587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d01b4-4d31-40fd-a6c3-a95f5bde9bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b218b47344fc483aafd8820bac65f2ff, group_id=50eca21cbf914262a17b18d5a8ae6efa, role_id=916b82353e034dbd9ae74f32d945ac09)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:15.147545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d01b4-4d31-40fd-a6c3-a95f5bde9bac admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:15.178711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 134/271] 10.222.0.27 () {58 vars in 1463 bytes} [Mon Oct 10 16:46:15 2022] PUT /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff/groups/50eca21cbf914262a17b18d5a8ae6efa/roles/916b82353e034dbd9ae74f32d945ac09 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:15.559527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b424812-f796-4068-810a-22f794ded7ad admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:15.570970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b424812-f796-4068-810a-22f794ded7ad admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.624640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07477-445b-41af-8ce5-d0eccea48b56 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.624945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07477-445b-41af-8ce5-d0eccea48b56 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.625190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07477-445b-41af-8ce5-d0eccea48b56 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.628007 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 135/272] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:15.636609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c804cd-542c-46d2-9bb3-cf1d6e2dceb9 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.636927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c804cd-542c-46d2-9bb3-cf1d6e2dceb9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.637164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c804cd-542c-46d2-9bb3-cf1d6e2dceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.639587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d6ec1-8038-4c61-910c-b92f1c1c323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.640238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6ec1-8038-4c61-910c-b92f1c1c323a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.640519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6ec1-8038-4c61-910c-b92f1c1c323a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.640796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6ec1-8038-4c61-910c-b92f1c1c323a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.654585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d6ec1-8038-4c61-910c-b92f1c1c323a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-325d6ec1-8038-4c61-910c-b92f1c1c323a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:15.661067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:15.663172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:15.665079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 138/273] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Oct 10 16:46:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:15.668552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d6ec1-8038-4c61-910c-b92f1c1c323a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:15.675518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f0c804cd-542c-46d2-9bb3-cf1d6e2dceb9 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:15.676718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f0c804cd-542c-46d2-9bb3-cf1d6e2dceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:15.680769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d6ec1-8038-4c61-910c-b92f1c1c323a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.686965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.687579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.688381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.688752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.689439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:15.689746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:15.691411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:15.701791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 139/274] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:46:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:15.708024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:15.719954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316ed9-f8a4-4a10-b35f-37971b94f505 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.729438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1f2f-493c-4b88-ac22-d47f413c3b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.730144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1f2f-493c-4b88-ac22-d47f413c3b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.730432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1f2f-493c-4b88-ac22-d47f413c3b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.730745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1f2f-493c-4b88-ac22-d47f413c3b13 admin admin] PATH_INFO: `/v3/groups/50eca21cbf914262a17b18d5a8ae6efa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.732324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e1f2f-493c-4b88-ac22-d47f413c3b13 admin admin] RBAC: Authorizing `identity:get_group(group_id=50eca21cbf914262a17b18d5a8ae6efa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:15.734546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e1f2f-493c-4b88-ac22-d47f413c3b13 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:15.736994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 140/275] 10.222.0.27 () {56 vars in 1201 bytes} [Mon Oct 10 16:46:15 2022] GET /identity/v3/groups/50eca21cbf914262a17b18d5a8ae6efa => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:15.742399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1f2f-493c-4b88-ac22-d47f413c3b13 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:15.753960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1f2f-493c-4b88-ac22-d47f413c3b13 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.759681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34dbbc-35dc-40aa-870f-51bca2522b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.760313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34dbbc-35dc-40aa-870f-51bca2522b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.760649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34dbbc-35dc-40aa-870f-51bca2522b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.760928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34dbbc-35dc-40aa-870f-51bca2522b92 admin admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.762383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34dbbc-35dc-40aa-870f-51bca2522b92 admin admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:15.764730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34dbbc-35dc-40aa-870f-51bca2522b92 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:15.766814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 141/276] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Oct 10 16:46:15 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:15.772474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34dbbc-35dc-40aa-870f-51bca2522b92 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:15.783118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:15.792278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34dbbc-35dc-40aa-870f-51bca2522b92 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:15.804061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958f16c-29a2-4600-920d-05d6dd4f8609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:15.806448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f16c-29a2-4600-920d-05d6dd4f8609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:15.806795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f16c-29a2-4600-920d-05d6dd4f8609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:15.807077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f16c-29a2-4600-920d-05d6dd4f8609 admin admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3/groups/50eca21cbf914262a17b18d5a8ae6efa/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:15.812022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958f16c-29a2-4600-920d-05d6dd4f8609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3404b245e3494ad0b5a108a32c6247e3, group_id=50eca21cbf914262a17b18d5a8ae6efa, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:15.815990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-c958f16c-29a2-4600-920d-05d6dd4f8609 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:46:15.815990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 10 16:46:15.815990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: Oct 10 16:46:15.820562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958f16c-29a2-4600-920d-05d6dd4f8609 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:15.837330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 136/277] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:15.847064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 142/278] 10.222.0.27 () {58 vars in 1463 bytes} [Mon Oct 10 16:46:15 2022] PUT /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3/groups/50eca21cbf914262a17b18d5a8ae6efa/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:46:16.116077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aa46-174b-4910-8aa2-6feaf4c978fd None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.116458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aa46-174b-4910-8aa2-6feaf4c978fd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.116643 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aa46-174b-4910-8aa2-6feaf4c978fd None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.118043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 137/279] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:16.123990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd87e0-66fc-4390-9095-7c180ebfc3db None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.124530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd87e0-66fc-4390-9095-7c180ebfc3db None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.124530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd87e0-66fc-4390-9095-7c180ebfc3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.156280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-99bd87e0-66fc-4390-9095-7c180ebfc3db None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:16.158311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-99bd87e0-66fc-4390-9095-7c180ebfc3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:16.232526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 143/280] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 10 16:46:16.260162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5aa46-174b-4910-8aa2-6feaf4c978fd None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.356714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:16.393984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5aa46-174b-4910-8aa2-6feaf4c978fd None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:16.443234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82579d22-6021-4765-bfc0-b19436c42279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:16.443870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579d22-6021-4765-bfc0-b19436c42279 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.444143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579d22-6021-4765-bfc0-b19436c42279 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.444412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579d22-6021-4765-bfc0-b19436c42279 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.455489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82579d22-6021-4765-bfc0-b19436c42279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-82579d22-6021-4765-bfc0-b19436c42279 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:16.460358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:16.461246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:16.462035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 138/281] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:16.467461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd87e0-66fc-4390-9095-7c180ebfc3db None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.588545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd87e0-66fc-4390-9095-7c180ebfc3db None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:16.626631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:16.627565 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.627853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.628130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.628806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:16.629113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:16.630505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:16.639491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:16.639749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 144/282] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:16.646982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82579d22-6021-4765-bfc0-b19436c42279 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.762310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.765545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82579d22-6021-4765-bfc0-b19436c42279 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:16.777907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df5a8-b61a-4396-a465-4f0b4168b750 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:16.786375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35223c9-47f2-41b5-8928-45236aa83bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:16.787048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35223c9-47f2-41b5-8928-45236aa83bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.787324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35223c9-47f2-41b5-8928-45236aa83bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.787596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35223c9-47f2-41b5-8928-45236aa83bd2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.804296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35223c9-47f2-41b5-8928-45236aa83bd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a35223c9-47f2-41b5-8928-45236aa83bd2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:16.811017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:16.812061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:16.813045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 145/283] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Oct 10 16:46:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:16.815291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:16.820485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35223c9-47f2-41b5-8928-45236aa83bd2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.821353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef321b9-6951-4ef0-8abd-8056dbbf975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:16.822197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef321b9-6951-4ef0-8abd-8056dbbf975d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.822669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef321b9-6951-4ef0-8abd-8056dbbf975d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.823134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef321b9-6951-4ef0-8abd-8056dbbf975d None admin] PATH_INFO: `/v3/users/b80a5dda28ed4bac924ed2bc83cc3191` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.824509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef321b9-6951-4ef0-8abd-8056dbbf975d None admin] RBAC: Authorizing `identity:get_user(user_id=b80a5dda28ed4bac924ed2bc83cc3191)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:16.826842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef321b9-6951-4ef0-8abd-8056dbbf975d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:16.830824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 139/284] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:46:16 2022] GET /identity/v3/users/b80a5dda28ed4bac924ed2bc83cc3191 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:16.833152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35223c9-47f2-41b5-8928-45236aa83bd2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:16.836020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef321b9-6951-4ef0-8abd-8056dbbf975d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.838994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:16.839677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.840027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.840371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.841972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:16.841972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:16.843239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:16.852844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 146/285] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Oct 10 16:46:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:16.858741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.869789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f352c-b32b-41b7-9c83-2217bf64999c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:16.879231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea9ff-6bac-4b88-a32e-6e812ba05ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:16.879981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea9ff-6bac-4b88-a32e-6e812ba05ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.882891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea9ff-6bac-4b88-a32e-6e812ba05ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.882891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea9ff-6bac-4b88-a32e-6e812ba05ff1 admin admin] PATH_INFO: `/v3/groups/50eca21cbf914262a17b18d5a8ae6efa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.883710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea9ff-6bac-4b88-a32e-6e812ba05ff1 admin admin] RBAC: Authorizing `identity:get_group(group_id=50eca21cbf914262a17b18d5a8ae6efa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:16.886595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea9ff-6bac-4b88-a32e-6e812ba05ff1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:16.888247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 147/286] 10.222.0.27 () {56 vars in 1201 bytes} [Mon Oct 10 16:46:16 2022] GET /identity/v3/groups/50eca21cbf914262a17b18d5a8ae6efa => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:16.903271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea9ff-6bac-4b88-a32e-6e812ba05ff1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.917836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea9ff-6bac-4b88-a32e-6e812ba05ff1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:16.925025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fce70-05bb-4ad6-ad98-d1bbd9d6a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:16.926664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fce70-05bb-4ad6-ad98-d1bbd9d6a450 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.927348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fce70-05bb-4ad6-ad98-d1bbd9d6a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.927932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fce70-05bb-4ad6-ad98-d1bbd9d6a450 admin admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.929292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fce70-05bb-4ad6-ad98-d1bbd9d6a450 admin admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:16.932638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fce70-05bb-4ad6-ad98-d1bbd9d6a450 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:16.935086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 148/287] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Oct 10 16:46:16 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:16.941316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fce70-05bb-4ad6-ad98-d1bbd9d6a450 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:16.962403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fce70-05bb-4ad6-ad98-d1bbd9d6a450 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:16.977670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d8f4e-646f-4de3-8f32-07336005d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:16.980110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8f4e-646f-4de3-8f32-07336005d5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:16.984241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8f4e-646f-4de3-8f32-07336005d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:16.984901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8f4e-646f-4de3-8f32-07336005d5dd admin admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3/groups/50eca21cbf914262a17b18d5a8ae6efa/roles/916b82353e034dbd9ae74f32d945ac09` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:16.987619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8f4e-646f-4de3-8f32-07336005d5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3404b245e3494ad0b5a108a32c6247e3, group_id=50eca21cbf914262a17b18d5a8ae6efa, role_id=916b82353e034dbd9ae74f32d945ac09)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:16.992437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8f4e-646f-4de3-8f32-07336005d5dd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:17.011452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef321b9-6951-4ef0-8abd-8056dbbf975d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:17.025348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 149/288] 10.222.0.27 () {58 vars in 1463 bytes} [Mon Oct 10 16:46:16 2022] PUT /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3/groups/50eca21cbf914262a17b18d5a8ae6efa/roles/916b82353e034dbd9ae74f32d945ac09 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:17.063499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf40d-5359-414b-9ee7-7f76c8a2688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:17.064541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf40d-5359-414b-9ee7-7f76c8a2688b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:17.065093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf40d-5359-414b-9ee7-7f76c8a2688b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:17.065571 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf40d-5359-414b-9ee7-7f76c8a2688b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:17.066657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf40d-5359-414b-9ee7-7f76c8a2688b None admin] RBAC: Adding query filter params (role.id=c481f43b9ca34894a93e66471cf203f2, user.id=b80a5dda28ed4bac924ed2bc83cc3191, scope.system=all) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:17.067214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf40d-5359-414b-9ee7-7f76c8a2688b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:17.069006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf40d-5359-414b-9ee7-7f76c8a2688b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:17.084256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 140/289] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Oct 10 16:46:16 2022] GET /identity/v3/role_assignments?user.id=b80a5dda28ed4bac924ed2bc83cc3191&scope.system=all&role.id=c481f43b9ca34894a93e66471cf203f2 => generated 510 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:17.138971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ad0b-0a5a-440f-a8b6-af9c9d95d3e4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:17.139972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ad0b-0a5a-440f-a8b6-af9c9d95d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:17.140482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ad0b-0a5a-440f-a8b6-af9c9d95d3e4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:17.143146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 150/290] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:17.148693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb83a-3dd6-44b0-95c5-89f684a0e57f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:17.149326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb83a-3dd6-44b0-95c5-89f684a0e57f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:17.149895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb83a-3dd6-44b0-95c5-89f684a0e57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:17.175119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-82cdb83a-3dd6-44b0-95c5-89f684a0e57f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:17.176784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-82cdb83a-3dd6-44b0-95c5-89f684a0e57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:17.264577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 141/291] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 10 16:46:17.754109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882ad0b-0a5a-440f-a8b6-af9c9d95d3e4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:17.769226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882ad0b-0a5a-440f-a8b6-af9c9d95d3e4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:17.773888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a8f06-c9f9-45d7-9d3f-387e89f8d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:17.774806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8f06-c9f9-45d7-9d3f-387e89f8d470 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:17.775289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8f06-c9f9-45d7-9d3f-387e89f8d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:17.775762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8f06-c9f9-45d7-9d3f-387e89f8d470 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:17.789742 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a8f06-c9f9-45d7-9d3f-387e89f8d470 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cb1a8f06-c9f9-45d7-9d3f-387e89f8d470 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:17.796320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:17.797291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:17.798096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:17.800740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 151/292] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Oct 10 16:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:17.806273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdb83a-3dd6-44b0-95c5-89f684a0e57f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:17.812279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:17.817534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdb83a-3dd6-44b0-95c5-89f684a0e57f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:17.824655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:17.825519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:17.826002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:17.826490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:17.827381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:17.827902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:17.830114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:17.840346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 142/293] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Oct 10 16:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:17.846478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a8f06-c9f9-45d7-9d3f-387e89f8d470 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:17.857421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a8f06-c9f9-45d7-9d3f-387e89f8d470 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:17.862854 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa388a-fba1-40c7-b5e1-8efac71e8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:17.863742 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa388a-fba1-40c7-b5e1-8efac71e8e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:17.864227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa388a-fba1-40c7-b5e1-8efac71e8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:17.864719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa388a-fba1-40c7-b5e1-8efac71e8e7b admin admin] PATH_INFO: `/v3/groups/018b867858424e548bc369dabe4666c5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:17.873021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa388a-fba1-40c7-b5e1-8efac71e8e7b admin admin] RBAC: Authorizing `identity:get_group(group_id=018b867858424e548bc369dabe4666c5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:17.875824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa388a-fba1-40c7-b5e1-8efac71e8e7b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:17.878138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 152/294] 10.222.0.27 () {56 vars in 1201 bytes} [Mon Oct 10 16:46:17 2022] GET /identity/v3/groups/018b867858424e548bc369dabe4666c5 => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:17.883960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:17.907578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f206-97b4-4faf-b488-b8dac847129a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:17.912404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8206f-14ad-4098-b92c-145762c70ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:17.913272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8206f-14ad-4098-b92c-145762c70ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:17.913756 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8206f-14ad-4098-b92c-145762c70ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:17.914235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8206f-14ad-4098-b92c-145762c70ba6 admin admin] PATH_INFO: `/v3/projects/900946e9f4af4713b0f50c103f092bc1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:17.919685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8206f-14ad-4098-b92c-145762c70ba6 admin admin] RBAC: Authorizing `identity:get_project(project_id=900946e9f4af4713b0f50c103f092bc1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:17.921724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8206f-14ad-4098-b92c-145762c70ba6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:17.924173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 143/295] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Oct 10 16:46:17 2022] GET /identity/v3/projects/900946e9f4af4713b0f50c103f092bc1 => generated 344 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:17.929550 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa388a-fba1-40c7-b5e1-8efac71e8e7b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:17.939940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa388a-fba1-40c7-b5e1-8efac71e8e7b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:17.950481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d0d20-c0f6-4a8d-b4ee-eba3b72f540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:17.951170 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d0d20-c0f6-4a8d-b4ee-eba3b72f540e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:17.951444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d0d20-c0f6-4a8d-b4ee-eba3b72f540e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:17.951713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d0d20-c0f6-4a8d-b4ee-eba3b72f540e admin admin] PATH_INFO: `/v3/projects/900946e9f4af4713b0f50c103f092bc1/groups/018b867858424e548bc369dabe4666c5/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:17.955822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d0d20-c0f6-4a8d-b4ee-eba3b72f540e admin admin] RBAC: Authorizing `identity:create_grant(project_id=900946e9f4af4713b0f50c103f092bc1, group_id=018b867858424e548bc369dabe4666c5, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:17.958468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d0d20-c0f6-4a8d-b4ee-eba3b72f540e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:17.981874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 153/296] 10.222.0.27 () {58 vars in 1463 bytes} [Mon Oct 10 16:46:17 2022] PUT /identity/v3/projects/900946e9f4af4713b0f50c103f092bc1/groups/018b867858424e548bc369dabe4666c5/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:18.336388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf3b5-b3b5-4def-9efe-72b735c1215f None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:18.337408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf3b5-b3b5-4def-9efe-72b735c1215f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:18.337899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf3b5-b3b5-4def-9efe-72b735c1215f None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:18.339893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 144/297] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:18.345111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51be2-035c-4541-ac7a-24b407b27c91 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:18.345545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51be2-035c-4541-ac7a-24b407b27c91 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:18.345717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51be2-035c-4541-ac7a-24b407b27c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:18.365487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-62c51be2-035c-4541-ac7a-24b407b27c91 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:18.366703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-62c51be2-035c-4541-ac7a-24b407b27c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:18.448072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 154/298] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:18.805843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaf3b5-b3b5-4def-9efe-72b735c1215f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:18.941467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaf3b5-b3b5-4def-9efe-72b735c1215f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:18.985781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6b2d-4988-4c6f-a6d7-118088bdc7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:18.986408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6b2d-4988-4c6f-a6d7-118088bdc7ed None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:18.986706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6b2d-4988-4c6f-a6d7-118088bdc7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:18.986975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6b2d-4988-4c6f-a6d7-118088bdc7ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:18.999670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6b2d-4988-4c6f-a6d7-118088bdc7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-227c6b2d-4988-4c6f-a6d7-118088bdc7ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:19.008390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:19.009280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:19.010072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 145/299] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:19.016381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51be2-035c-4541-ac7a-24b407b27c91 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:19.082411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:19.143995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51be2-035c-4541-ac7a-24b407b27c91 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:19.160586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0dded-aec5-4c8d-84c2-424838305d8e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.160887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0dded-aec5-4c8d-84c2-424838305d8e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.161133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0dded-aec5-4c8d-84c2-424838305d8e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.162969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 146/300] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:19.170568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81d8b-1fe3-4ae6-96e2-c512aec64617 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.170854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81d8b-1fe3-4ae6-96e2-c512aec64617 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.171122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81d8b-1fe3-4ae6-96e2-c512aec64617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.198654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6cf81d8b-1fe3-4ae6-96e2-c512aec64617 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:19.200179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6cf81d8b-1fe3-4ae6-96e2-c512aec64617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:19.202051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:19.204026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.204026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.204026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.204620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:19.205019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:19.206890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:19.222951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 155/301] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:19.228602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:19.264715 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:19.303632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 147/302] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:19.304914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf75c-e849-402a-9437-8ae449d949ee None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.305198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf75c-e849-402a-9437-8ae449d949ee None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.305470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf75c-e849-402a-9437-8ae449d949ee None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.306872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 148/303] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:19.312654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348eb45-a477-4902-88d0-e70a5dee3b30 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.313490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348eb45-a477-4902-88d0-e70a5dee3b30 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.313768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348eb45-a477-4902-88d0-e70a5dee3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.355790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2348eb45-a477-4902-88d0-e70a5dee3b30 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:19.356928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2348eb45-a477-4902-88d0-e70a5dee3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:19.385348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02992d-8360-402f-bd9a-0f02b4009fdf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:19.410157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:19.433525 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f42d9-ccf1-4e20-b3bd-26a5f4f5c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:19.436152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f42d9-ccf1-4e20-b3bd-26a5f4f5c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.436435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f42d9-ccf1-4e20-b3bd-26a5f4f5c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.436708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f42d9-ccf1-4e20-b3bd-26a5f4f5c1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.507444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 149/304] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:19.548722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f42d9-ccf1-4e20-b3bd-26a5f4f5c1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:19.550230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f42d9-ccf1-4e20-b3bd-26a5f4f5c1d5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:19.660406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 156/305] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 16:46:19.665832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348eb45-a477-4902-88d0-e70a5dee3b30 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:19.696804 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f42d9-ccf1-4e20-b3bd-26a5f4f5c1d5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:19.719079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:19.832649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348eb45-a477-4902-88d0-e70a5dee3b30 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:19.848461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:19.877834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f42d9-ccf1-4e20-b3bd-26a5f4f5c1d5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:19.897558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a32753-ffbc-4a83-9ca4-d099ba500c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:19.897702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32753-ffbc-4a83-9ca4-d099ba500c2e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.897898 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32753-ffbc-4a83-9ca4-d099ba500c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.898143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32753-ffbc-4a83-9ca4-d099ba500c2e None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.900752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a32753-ffbc-4a83-9ca4-d099ba500c2e None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:19.900752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a32753-ffbc-4a83-9ca4-d099ba500c2e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:19.902659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 150/306] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:46:19 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:19.903786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9ca35-9118-4353-9843-40929737f192 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.904228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9ca35-9118-4353-9843-40929737f192 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.906568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9ca35-9118-4353-9843-40929737f192 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.911367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 151/307] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:19.912368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9ca35-9118-4353-9843-40929737f192 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:19.926165 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0b4e2-ada5-4836-9b9c-e34dd811ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:19.926839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b4e2-ada5-4836-9b9c-e34dd811ef6d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.927145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b4e2-ada5-4836-9b9c-e34dd811ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.927398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b4e2-ada5-4836-9b9c-e34dd811ef6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.947801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0b4e2-ada5-4836-9b9c-e34dd811ef6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-eec0b4e2-ada5-4836-9b9c-e34dd811ef6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:19.952757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:19.954248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:19.955149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:19.958679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 157/308] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:46:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:19.960184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbcf6-d38e-4951-8249-498c34d2aa9d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:19.960617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbcf6-d38e-4951-8249-498c34d2aa9d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:19.961062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dbcf6-d38e-4951-8249-498c34d2aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:19.985458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4d6dbcf6-d38e-4951-8249-498c34d2aa9d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:19.987168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d6dbcf6-d38e-4951-8249-498c34d2aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:20.033222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9ca35-9118-4353-9843-40929737f192 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:20.077946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec084a-63f5-4e13-9508-028a996be8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:20.078819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 158/309] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:20.078931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec084a-63f5-4e13-9508-028a996be8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:20.079150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec084a-63f5-4e13-9508-028a996be8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:20.079419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec084a-63f5-4e13-9508-028a996be8a9 None admin] PATH_INFO: `/v3/groups/50eca21cbf914262a17b18d5a8ae6efa` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:20.079761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dbcf6-d38e-4951-8249-498c34d2aa9d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:20.080681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec084a-63f5-4e13-9508-028a996be8a9 None admin] RBAC: Authorizing `identity:get_group(group_id=50eca21cbf914262a17b18d5a8ae6efa)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:20.082095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec084a-63f5-4e13-9508-028a996be8a9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:20.083857 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 152/310] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Oct 10 16:46:19 2022] GET /identity/v3/groups/50eca21cbf914262a17b18d5a8ae6efa => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:20.089393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec084a-63f5-4e13-9508-028a996be8a9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:20.089514 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:20.145691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:20.214216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dbcf6-d38e-4951-8249-498c34d2aa9d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:20.226657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec084a-63f5-4e13-9508-028a996be8a9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:20.257106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a95c-3217-4ca9-b53d-fe5888655247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:20.258650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a95c-3217-4ca9-b53d-fe5888655247 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:20.259088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a95c-3217-4ca9-b53d-fe5888655247 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:20.259767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a95c-3217-4ca9-b53d-fe5888655247 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:20.267404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:20.268417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:20.268787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:20.269089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:20.269739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:20.270041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:20.271451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:20.274429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a95c-3217-4ca9-b53d-fe5888655247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-32f0a95c-3217-4ca9-b53d-fe5888655247 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:20.280879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:20.282692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 16:46:20.283678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:20.284374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 153/311] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:20.284374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:20.285782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 159/312] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:20.288350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a95c-3217-4ca9-b53d-fe5888655247 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:20.374937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:20.420752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a95c-3217-4ca9-b53d-fe5888655247 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:20.428550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50f86-134b-4749-861e-058501de7d17 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:20.441651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:20.474927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:20.475459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:20.475740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:20.478546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:20.478546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] RBAC: Adding query filter params (group.id=50eca21cbf914262a17b18d5a8ae6efa, role.id=f9fed2e211414db0aa72e25fcc59d6f8, scope.project.id=b218b47344fc483aafd8820bac65f2ff) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:20.478546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:20.478546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:20.480263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efb459-cda9-498b-b25f-beea8d6bdb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:20.480893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb459-cda9-498b-b25f-beea8d6bdb06 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:20.481176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb459-cda9-498b-b25f-beea8d6bdb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:20.481451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb459-cda9-498b-b25f-beea8d6bdb06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:20.485918 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 154/313] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Oct 10 16:46:20 2022] GET /identity/v3/role_assignments?group.id=50eca21cbf914262a17b18d5a8ae6efa&scope.project.id=b218b47344fc483aafd8820bac65f2ff&role.id=f9fed2e211414db0aa72e25fcc59d6f8 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:20.486623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:20.575780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efb459-cda9-498b-b25f-beea8d6bdb06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:20.577318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efb459-cda9-498b-b25f-beea8d6bdb06 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:20.622436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a1deb-066e-4d57-a0d6-18629979c51b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:20.663073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:20.663375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:20.663953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:20.664230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:20.664500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:20.665167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:20.665466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:20.666928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:20.682061 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 155/314] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:46:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:20.683136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:20.704031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 160/315] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:20.704963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efb459-cda9-498b-b25f-beea8d6bdb06 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:20.729266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:20.815639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0057e9-f29f-442c-bcd3-7661f6123816 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:20.857721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efb459-cda9-498b-b25f-beea8d6bdb06 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:20.863192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fb781-2d1e-49cb-b9d9-9098b8d526d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:20.863845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fb781-2d1e-49cb-b9d9-9098b8d526d3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:20.864128 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fb781-2d1e-49cb-b9d9-9098b8d526d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:20.864403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fb781-2d1e-49cb-b9d9-9098b8d526d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:20.878679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fb781-2d1e-49cb-b9d9-9098b8d526d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-324fb781-2d1e-49cb-b9d9-9098b8d526d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:20.884108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:20.884964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:20.885757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 156/316] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:46:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:20.886387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fb781-2d1e-49cb-b9d9-9098b8d526d3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:20.920190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd09cb8-f2d3-4649-bfdb-f1d4511fe9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:20.920814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09cb8-f2d3-4649-bfdb-f1d4511fe9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:20.921126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09cb8-f2d3-4649-bfdb-f1d4511fe9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:20.921365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09cb8-f2d3-4649-bfdb-f1d4511fe9e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:20.972752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:21.014433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:21.018553 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd09cb8-f2d3-4649-bfdb-f1d4511fe9e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.020130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd09cb8-f2d3-4649-bfdb-f1d4511fe9e6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.022462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fb781-2d1e-49cb-b9d9-9098b8d526d3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.062549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7361b9-616d-4218-a6b4-1419ddce60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.063477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7361b9-616d-4218-a6b4-1419ddce60a9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.063761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7361b9-616d-4218-a6b4-1419ddce60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.064035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7361b9-616d-4218-a6b4-1419ddce60a9 None admin] PATH_INFO: `/v3/projects/b218b47344fc483aafd8820bac65f2ff` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.065187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7361b9-616d-4218-a6b4-1419ddce60a9 None admin] RBAC: Authorizing `identity:get_project(project_id=b218b47344fc483aafd8820bac65f2ff)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.066686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7361b9-616d-4218-a6b4-1419ddce60a9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.068544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 157/317] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:46:20 2022] GET /identity/v3/projects/b218b47344fc483aafd8820bac65f2ff => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:21.069089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7361b9-616d-4218-a6b4-1419ddce60a9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.148378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 161/318] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:21.149708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9b741-0ad5-4924-b85c-b2993f236d06 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.149995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9b741-0ad5-4924-b85c-b2993f236d06 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.150267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9b741-0ad5-4924-b85c-b2993f236d06 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.151551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 162/319] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:21.155709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9b741-0ad5-4924-b85c-b2993f236d06 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.187087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7361b9-616d-4218-a6b4-1419ddce60a9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.224518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.225479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.225754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.226023 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.226784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:21.227016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.228794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.229377 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:21.237611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 158/320] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:21.237611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.267380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:21.284562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9b741-0ad5-4924-b85c-b2993f236d06 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.323288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233c76-2183-461f-8c38-33c174ee3505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.324211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233c76-2183-461f-8c38-33c174ee3505 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.324211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233c76-2183-461f-8c38-33c174ee3505 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.324451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233c76-2183-461f-8c38-33c174ee3505 None admin] PATH_INFO: `/v3/groups/50eca21cbf914262a17b18d5a8ae6efa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.327252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233c76-2183-461f-8c38-33c174ee3505 None admin] RBAC: Authorizing `identity:get_group(group_id=50eca21cbf914262a17b18d5a8ae6efa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.329433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233c76-2183-461f-8c38-33c174ee3505 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.331059 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 163/321] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/groups/50eca21cbf914262a17b18d5a8ae6efa => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:21.332189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51dbc-f94a-4c4e-8e07-28587c108aa2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.332469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51dbc-f94a-4c4e-8e07-28587c108aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.332739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51dbc-f94a-4c4e-8e07-28587c108aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.351807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-15b51dbc-f94a-4c4e-8e07-28587c108aa2 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:21.352987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-15b51dbc-f94a-4c4e-8e07-28587c108aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:21.367387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985722-9858-4d8c-812d-fef152a17f61 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.409336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14f09-d692-4b61-8253-96b25a56fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.410569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14f09-d692-4b61-8253-96b25a56fb48 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.410569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14f09-d692-4b61-8253-96b25a56fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.410569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df14f09-d692-4b61-8253-96b25a56fb48 None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.412837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df14f09-d692-4b61-8253-96b25a56fb48 None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.413132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df14f09-d692-4b61-8253-96b25a56fb48 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.414790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 159/322] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:21.417439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14f09-d692-4b61-8253-96b25a56fb48 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.433716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 164/323] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:21.435242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b51dbc-f94a-4c4e-8e07-28587c108aa2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.518169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:21.523256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:21.534716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df14f09-d692-4b61-8253-96b25a56fb48 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.558499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b51dbc-f94a-4c4e-8e07-28587c108aa2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.570108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c543b-0e9b-4a1a-a791-02a468c8640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.570734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c543b-0e9b-4a1a-a791-02a468c8640a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.571009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c543b-0e9b-4a1a-a791-02a468c8640a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.571278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c543b-0e9b-4a1a-a791-02a468c8640a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.594794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.595404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.595676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.595948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.596666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] RBAC: Adding query filter params (group.id=50eca21cbf914262a17b18d5a8ae6efa, role.id=916b82353e034dbd9ae74f32d945ac09, scope.project.id=b218b47344fc483aafd8820bac65f2ff) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:21.596965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.598383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.604327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 165/324] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/role_assignments?group.id=50eca21cbf914262a17b18d5a8ae6efa&scope.project.id=b218b47344fc483aafd8820bac65f2ff&role.id=916b82353e034dbd9ae74f32d945ac09 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:21.605128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.645860 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c543b-0e9b-4a1a-a791-02a468c8640a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.647633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c543b-0e9b-4a1a-a791-02a468c8640a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.745347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e7d17-1b1a-4199-a425-113ff054277b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.755257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:21.767936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 160/325] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:21.769195 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c543b-0e9b-4a1a-a791-02a468c8640a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.782128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:21.791711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04415a6e-ada3-4066-b4db-f335eed5d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.792346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415a6e-ada3-4066-b4db-f335eed5d519 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.792624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415a6e-ada3-4066-b4db-f335eed5d519 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.792892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415a6e-ada3-4066-b4db-f335eed5d519 None admin] PATH_INFO: `/v3/groups/50eca21cbf914262a17b18d5a8ae6efa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.794649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04415a6e-ada3-4066-b4db-f335eed5d519 None admin] RBAC: Authorizing `identity:get_group(group_id=50eca21cbf914262a17b18d5a8ae6efa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.796002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04415a6e-ada3-4066-b4db-f335eed5d519 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.798285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 166/326] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/groups/50eca21cbf914262a17b18d5a8ae6efa => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:21.798494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04415a6e-ada3-4066-b4db-f335eed5d519 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.890791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c543b-0e9b-4a1a-a791-02a468c8640a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.929322 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04415a6e-ada3-4066-b4db-f335eed5d519 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:21.937132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791403-a432-4b36-9a6d-b9e0a3220250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.937867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791403-a432-4b36-9a6d-b9e0a3220250 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.938147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791403-a432-4b36-9a6d-b9e0a3220250 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.938503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791403-a432-4b36-9a6d-b9e0a3220250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.951935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0791403-a432-4b36-9a6d-b9e0a3220250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b0791403-a432-4b36-9a6d-b9e0a3220250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:21.957572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:21.958540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:21.959480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 161/327] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:21.960124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791403-a432-4b36-9a6d-b9e0a3220250 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:21.975262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec65ff-09d1-4efa-9dc6-3850cead0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:21.976716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec65ff-09d1-4efa-9dc6-3850cead0740 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:21.976716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec65ff-09d1-4efa-9dc6-3850cead0740 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:21.976716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec65ff-09d1-4efa-9dc6-3850cead0740 None admin] PATH_INFO: `/v3/projects/3404b245e3494ad0b5a108a32c6247e3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:21.977593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec65ff-09d1-4efa-9dc6-3850cead0740 None admin] RBAC: Authorizing `identity:get_project(project_id=3404b245e3494ad0b5a108a32c6247e3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:21.979111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec65ff-09d1-4efa-9dc6-3850cead0740 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:21.980900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 167/328] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/projects/3404b245e3494ad0b5a108a32c6247e3 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:21.981516 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec65ff-09d1-4efa-9dc6-3850cead0740 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:22.020826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:22.048063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:22.067782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791403-a432-4b36-9a6d-b9e0a3220250 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:22.086931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec65ff-09d1-4efa-9dc6-3850cead0740 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:22.101524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:22.102114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:22.102388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:22.102692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:22.103413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] RBAC: Adding query filter params (group.id=50eca21cbf914262a17b18d5a8ae6efa, role.id=f9fed2e211414db0aa72e25fcc59d6f8, scope.project.id=3404b245e3494ad0b5a108a32c6247e3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:22.103730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:22.105138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:22.110684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 162/329] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/role_assignments?group.id=50eca21cbf914262a17b18d5a8ae6efa&scope.project.id=3404b245e3494ad0b5a108a32c6247e3&role.id=f9fed2e211414db0aa72e25fcc59d6f8 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:22.111443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:22.121146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:22.121799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:22.122078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:22.122350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:22.123070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:22.123371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:22.124775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:22.138624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 168/330] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:22.140538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:22.230146 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03940d-b539-46e7-ab42-d75df8a4e7b9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:22.249971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:22.261517 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baa22-4121-4c83-86dc-c9799c0e8dfb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:22.269625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d0636-a5cf-4a9a-a57d-1245bc5448ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:22.270276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d0636-a5cf-4a9a-a57d-1245bc5448ed None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:22.270570 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d0636-a5cf-4a9a-a57d-1245bc5448ed None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:22.270904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d0636-a5cf-4a9a-a57d-1245bc5448ed None admin] PATH_INFO: `/v3/groups/50eca21cbf914262a17b18d5a8ae6efa` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:22.271981 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d0636-a5cf-4a9a-a57d-1245bc5448ed None admin] RBAC: Authorizing `identity:get_group(group_id=50eca21cbf914262a17b18d5a8ae6efa)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:22.273429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d0636-a5cf-4a9a-a57d-1245bc5448ed None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:22.275212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 163/331] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Oct 10 16:46:22 2022] GET /identity/v3/groups/50eca21cbf914262a17b18d5a8ae6efa => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:22.283368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d0636-a5cf-4a9a-a57d-1245bc5448ed None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:22.292537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:22.302926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33cbf7-54fa-4123-a7f8-d9fcfed0331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:22.303565 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33cbf7-54fa-4123-a7f8-d9fcfed0331e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:22.303846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33cbf7-54fa-4123-a7f8-d9fcfed0331e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:22.304118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33cbf7-54fa-4123-a7f8-d9fcfed0331e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:22.378495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33cbf7-54fa-4123-a7f8-d9fcfed0331e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:22.380006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33cbf7-54fa-4123-a7f8-d9fcfed0331e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:22.402872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d0636-a5cf-4a9a-a57d-1245bc5448ed None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:22.438884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:22.441948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:22.441948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:22.441948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:22.441948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] RBAC: Adding query filter params (group.id=50eca21cbf914262a17b18d5a8ae6efa, role.id=916b82353e034dbd9ae74f32d945ac09, scope.project.id=3404b245e3494ad0b5a108a32c6247e3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:22.441948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:22.442431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:22.449624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 164/332] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Oct 10 16:46:22 2022] GET /identity/v3/role_assignments?group.id=50eca21cbf914262a17b18d5a8ae6efa&scope.project.id=3404b245e3494ad0b5a108a32c6247e3&role.id=916b82353e034dbd9ae74f32d945ac09 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:22.494768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 169/333] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 16:46:22.501677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:22.559870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:22.613962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434ef8a-e621-4a1e-887b-849c519ea83f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:22.649246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637427c-bb36-40fe-9a88-54270afe23e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:22.649876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637427c-bb36-40fe-9a88-54270afe23e2 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:22.650158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637427c-bb36-40fe-9a88-54270afe23e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:22.650435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637427c-bb36-40fe-9a88-54270afe23e2 None admin] PATH_INFO: `/v3/projects/900946e9f4af4713b0f50c103f092bc1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:22.651620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637427c-bb36-40fe-9a88-54270afe23e2 None admin] RBAC: Authorizing `identity:get_project(project_id=900946e9f4af4713b0f50c103f092bc1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:22.653073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637427c-bb36-40fe-9a88-54270afe23e2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:22.654741 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 165/334] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:46:22 2022] GET /identity/v3/projects/900946e9f4af4713b0f50c103f092bc1 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:22.660397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33cbf7-54fa-4123-a7f8-d9fcfed0331e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:22.691351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:22.770175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33cbf7-54fa-4123-a7f8-d9fcfed0331e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:22.804273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5370810-7430-49b6-a087-ba9364cf6e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:22.804904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5370810-7430-49b6-a087-ba9364cf6e41 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:22.805183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5370810-7430-49b6-a087-ba9364cf6e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:22.805458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5370810-7430-49b6-a087-ba9364cf6e41 None admin] PATH_INFO: `/v3/groups/018b867858424e548bc369dabe4666c5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:22.806578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5370810-7430-49b6-a087-ba9364cf6e41 None admin] RBAC: Authorizing `identity:get_group(group_id=018b867858424e548bc369dabe4666c5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:22.808013 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5370810-7430-49b6-a087-ba9364cf6e41 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:22.809577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 170/335] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Oct 10 16:46:22 2022] GET /identity/v3/groups/018b867858424e548bc369dabe4666c5 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:22.816480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637427c-bb36-40fe-9a88-54270afe23e2 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:22.915593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637427c-bb36-40fe-9a88-54270afe23e2 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:22.931393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:22.949011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee34fd-bf73-45f7-b03c-8441b2d80648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:22.949608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee34fd-bf73-45f7-b03c-8441b2d80648 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:22.949887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee34fd-bf73-45f7-b03c-8441b2d80648 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:22.950160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee34fd-bf73-45f7-b03c-8441b2d80648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:22.950909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee34fd-bf73-45f7-b03c-8441b2d80648 None admin] RBAC: Adding query filter params (group.id=018b867858424e548bc369dabe4666c5, role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=900946e9f4af4713b0f50c103f092bc1) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:22.951240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee34fd-bf73-45f7-b03c-8441b2d80648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:22.952673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee34fd-bf73-45f7-b03c-8441b2d80648 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:22.958323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 166/336] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Oct 10 16:46:22 2022] GET /identity/v3/role_assignments?group.id=018b867858424e548bc369dabe4666c5&scope.project.id=900946e9f4af4713b0f50c103f092bc1&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:25.540672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b791e0-5ce8-4508-937a-6541abf9bf9e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:25.541214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b791e0-5ce8-4508-937a-6541abf9bf9e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:25.541214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b791e0-5ce8-4508-937a-6541abf9bf9e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:25.543038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 171/337] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:25.548104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461263da-25fc-4546-a727-ee4da7877a66 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:25.548523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461263da-25fc-4546-a727-ee4da7877a66 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:25.548696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461263da-25fc-4546-a727-ee4da7877a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:25.573950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-461263da-25fc-4546-a727-ee4da7877a66 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:25.575169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-461263da-25fc-4546-a727-ee4da7877a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:25.666271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 167/338] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:25.955459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6060b8-663d-4b33-861a-f8cdf2f9a545 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:25.955740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6060b8-663d-4b33-861a-f8cdf2f9a545 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:25.956185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6060b8-663d-4b33-861a-f8cdf2f9a545 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:25.957800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 172/339] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:25.963455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0754d6-153d-4005-bcb0-3c14c41faf76 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:25.963940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0754d6-153d-4005-bcb0-3c14c41faf76 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:25.965420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21ed5-192f-456a-a040-cedeb45bb08e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:25.965921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21ed5-192f-456a-a040-cedeb45bb08e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:25.966435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21ed5-192f-456a-a040-cedeb45bb08e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:25.967933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 173/340] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:25.968320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0754d6-153d-4005-bcb0-3c14c41faf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:25.974698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab928-005c-4366-8372-3c0ca3d4d7a9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:25.974698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab928-005c-4366-8372-3c0ca3d4d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:25.974698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab928-005c-4366-8372-3c0ca3d4d7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:25.998489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3e6ab928-005c-4366-8372-3c0ca3d4d7a9 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:25.999550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-af0754d6-153d-4005-bcb0-3c14c41faf76 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:26.001208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3e6ab928-005c-4366-8372-3c0ca3d4d7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:26.002137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-af0754d6-153d-4005-bcb0-3c14c41faf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:26.120102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 168/341] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:26.120979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0754d6-153d-4005-bcb0-3c14c41faf76 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:26.129939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 174/342] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:26.212566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:26.286806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0754d6-153d-4005-bcb0-3c14c41faf76 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:26.338892 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315593b-d708-442b-a098-3a6183951fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:26.339966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315593b-d708-442b-a098-3a6183951fad None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:26.340469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315593b-d708-442b-a098-3a6183951fad None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:26.340959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315593b-d708-442b-a098-3a6183951fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:26.356588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315593b-d708-442b-a098-3a6183951fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:26.358452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315593b-d708-442b-a098-3a6183951fad None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-9315593b-d708-442b-a098-3a6183951fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:26.385558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:26.386605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:26.387485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:26.387485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:26.387485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:26.389588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 169/343] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:26.395497 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ab928-005c-4366-8372-3c0ca3d4d7a9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:26.447724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315593b-d708-442b-a098-3a6183951fad None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:26.454489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:26.560242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ab928-005c-4366-8372-3c0ca3d4d7a9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:26.579587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:26.589751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315593b-d708-442b-a098-3a6183951fad None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:26.599052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2b55-8f49-4973-ac63-b1567df809ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:26.599666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2b55-8f49-4973-ac63-b1567df809ee None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:26.600008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2b55-8f49-4973-ac63-b1567df809ee None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:26.600287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2b55-8f49-4973-ac63-b1567df809ee None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:26.600938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2b55-8f49-4973-ac63-b1567df809ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:26.601244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2b55-8f49-4973-ac63-b1567df809ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:26.602627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2b55-8f49-4973-ac63-b1567df809ee None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:26.614986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 175/344] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:26.620506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dbacc-4008-498d-9fef-87764d73ff27 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:26.620790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dbacc-4008-498d-9fef-87764d73ff27 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:26.621089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dbacc-4008-498d-9fef-87764d73ff27 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:26.622420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 176/345] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:26.623072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dbacc-4008-498d-9fef-87764d73ff27 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:26.630989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:26.631626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:26.631905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:26.632180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:26.645147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:26.646656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:26.661964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:26.662962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:26.663817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:26.663817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:26.663817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:26.663817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 170/346] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:26.664689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:26.720741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:26.738617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dbacc-4008-498d-9fef-87764d73ff27 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:26.774727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f4a66-f17f-46f5-98b6-8ff44fa80546 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:26.775260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0fde1-668d-4a3b-b66b-bb8aa2af7510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:26.775903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0fde1-668d-4a3b-b66b-bb8aa2af7510 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:26.776194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0fde1-668d-4a3b-b66b-bb8aa2af7510 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:26.776453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0fde1-668d-4a3b-b66b-bb8aa2af7510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:26.787785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0fde1-668d-4a3b-b66b-bb8aa2af7510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:26.789221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0fde1-668d-4a3b-b66b-bb8aa2af7510 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c8f0fde1-668d-4a3b-b66b-bb8aa2af7510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:26.803445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:26.804319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:26.805155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:26.805155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:26.805155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:26.805155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 177/347] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:26.805911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88f70-e215-4dda-88c3-c891197696fc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:26.806019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88f70-e215-4dda-88c3-c891197696fc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:26.806252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88f70-e215-4dda-88c3-c891197696fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:26.815877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f0f49-e9ae-4636-97d7-c8ba5fb18012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:26.816425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f0f49-e9ae-4636-97d7-c8ba5fb18012 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:26.816715 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f0f49-e9ae-4636-97d7-c8ba5fb18012 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:26.817010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f0f49-e9ae-4636-97d7-c8ba5fb18012 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:26.817613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f0f49-e9ae-4636-97d7-c8ba5fb18012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:26.819079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f0f49-e9ae-4636-97d7-c8ba5fb18012 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:26.824800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fcb88f70-e215-4dda-88c3-c891197696fc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:26.825971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fcb88f70-e215-4dda-88c3-c891197696fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:26.837079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:26.851076 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 171/348] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:46:26 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:26.852740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f0f49-e9ae-4636-97d7-c8ba5fb18012 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:26.934987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 178/349] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:26.936332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb88f70-e215-4dda-88c3-c891197696fc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:26.986470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f0f49-e9ae-4636-97d7-c8ba5fb18012 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:27.020434 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:27.046433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f99ece-c9d7-4499-8cce-1a5c86f57799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:27.047403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99ece-c9d7-4499-8cce-1a5c86f57799 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.047682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99ece-c9d7-4499-8cce-1a5c86f57799 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.047957 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99ece-c9d7-4499-8cce-1a5c86f57799 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.049017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f99ece-c9d7-4499-8cce-1a5c86f57799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:27.049211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f99ece-c9d7-4499-8cce-1a5c86f57799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:27.050633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f99ece-c9d7-4499-8cce-1a5c86f57799 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:27.073162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb88f70-e215-4dda-88c3-c891197696fc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:27.076454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 172/350] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:27.077706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d431-775b-4c94-9e08-c62a18b16c81 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.078142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d431-775b-4c94-9e08-c62a18b16c81 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.078422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d431-775b-4c94-9e08-c62a18b16c81 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.083260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 173/351] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:27.084345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d431-775b-4c94-9e08-c62a18b16c81 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:27.119922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7d922-7d59-4dae-a6d0-9cb4ce57a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:27.120776 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d922-7d59-4dae-a6d0-9cb4ce57a40d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.121054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d922-7d59-4dae-a6d0-9cb4ce57a40d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.121321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d922-7d59-4dae-a6d0-9cb4ce57a40d None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.121960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7d922-7d59-4dae-a6d0-9cb4ce57a40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:27.122259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7d922-7d59-4dae-a6d0-9cb4ce57a40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:27.123670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7d922-7d59-4dae-a6d0-9cb4ce57a40d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:27.136891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 179/352] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:27.141363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665fbf-e7e6-4cbe-a4ad-0f395e5dcab0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.141363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665fbf-e7e6-4cbe-a4ad-0f395e5dcab0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.141363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665fbf-e7e6-4cbe-a4ad-0f395e5dcab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.157352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:27.157890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-50665fbf-e7e6-4cbe-a4ad-0f395e5dcab0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:27.159106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-50665fbf-e7e6-4cbe-a4ad-0f395e5dcab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:27.201717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d431-775b-4c94-9e08-c62a18b16c81 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:27.231846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 180/353] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:27.232766 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50665fbf-e7e6-4cbe-a4ad-0f395e5dcab0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:27.253838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b2e37-cc22-4c8d-b093-dc5e80a7982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:27.254625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b2e37-cc22-4c8d-b093-dc5e80a7982d None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.255042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b2e37-cc22-4c8d-b093-dc5e80a7982d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.255412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b2e37-cc22-4c8d-b093-dc5e80a7982d None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.256289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b2e37-cc22-4c8d-b093-dc5e80a7982d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:27.257836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b2e37-cc22-4c8d-b093-dc5e80a7982d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:27.292706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 174/354] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:46:27 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:27.293620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b2e37-cc22-4c8d-b093-dc5e80a7982d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:27.301433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:27.356944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50665fbf-e7e6-4cbe-a4ad-0f395e5dcab0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:27.424997 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6b9f6-42c5-4619-896d-0a9b108c4d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:27.425912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b9f6-42c5-4619-896d-0a9b108c4d79 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.426332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b9f6-42c5-4619-896d-0a9b108c4d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.426808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b9f6-42c5-4619-896d-0a9b108c4d79 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.428946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6b9f6-42c5-4619-896d-0a9b108c4d79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:27.430601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6b9f6-42c5-4619-896d-0a9b108c4d79 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:27.451232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b2e37-cc22-4c8d-b093-dc5e80a7982d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:27.464763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 181/355] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:46:27 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:27.480356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:27.505467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:27.506699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.507190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.507669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.523743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:27.525602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:27.543252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:27.544199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:27.545038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:27.545038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:27.545038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:27.547442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 175/356] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:27.553203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6b9f6-42c5-4619-896d-0a9b108c4d79 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:27.603454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:27.686490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6b9f6-42c5-4619-896d-0a9b108c4d79 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:27.701987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:27.729479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4bddc-adbe-4ced-a9fe-58bc51018144 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:27.730330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:27.731081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.731358 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.731624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.732383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:27.732686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:27.734044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:27.749244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 182/357] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:27.755492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:27.776385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:27.777484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.777764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.778168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.779158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:27.781836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:27.791671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.sql.core [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 16:46:27.791671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 10 16:46:27.791671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [parameters: {'id': 'bf5778395d4a4b12a589b84c8e498f1d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 10 16:46:27.791671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result.read() Oct 10 16:46:27.814980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return ref.to_dict() Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:46:27.815908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application yield resource Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise self.value Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application session.commit() Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 16:46:27.816824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.session.flush() Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application compat.raise_( Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 16:46:27.818659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:46:27.820060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result.read() Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:46:27.821134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [parameters: {'id': 'bf5778395d4a4b12a589b84c8e498f1d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:27.822082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 10 16:46:27.829187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:27.830876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 176/358] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Oct 10 16:46:27 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:27.831901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:27.873939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:27.906556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fad04-b3d4-486e-97ad-3c1403e2b0b9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:27.937935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e13cb-36ab-4fdd-97f1-5d8b1c7a1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:27.938634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e13cb-36ab-4fdd-97f1-5d8b1c7a1b27 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:27.938918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e13cb-36ab-4fdd-97f1-5d8b1c7a1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:27.939191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e13cb-36ab-4fdd-97f1-5d8b1c7a1b27 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:27.939860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e13cb-36ab-4fdd-97f1-5d8b1c7a1b27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:27.941430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e13cb-36ab-4fdd-97f1-5d8b1c7a1b27 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:27.966707 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 183/359] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:46:27 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:27.982861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffcf5e-72ee-4974-9b81-b92912bb031f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:28.034173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ae97a-a974-4eab-8c75-2e343dbb0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:28.034842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae97a-a974-4eab-8c75-2e343dbb0922 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:28.035119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae97a-a974-4eab-8c75-2e343dbb0922 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:28.035386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae97a-a974-4eab-8c75-2e343dbb0922 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:28.046732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ae97a-a974-4eab-8c75-2e343dbb0922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ed7ae97a-a974-4eab-8c75-2e343dbb0922 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:28.052831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:28.053762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:28.054588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 177/360] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:46:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:28.064018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e13cb-36ab-4fdd-97f1-5d8b1c7a1b27 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:28.119019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:28.187796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e13cb-36ab-4fdd-97f1-5d8b1c7a1b27 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:28.225490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97750ff-b412-4c65-8fba-a1e461d03ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:28.226029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97750ff-b412-4c65-8fba-a1e461d03ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:28.226304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97750ff-b412-4c65-8fba-a1e461d03ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:28.226662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97750ff-b412-4c65-8fba-a1e461d03ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:28.227334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97750ff-b412-4c65-8fba-a1e461d03ae7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:28.227632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97750ff-b412-4c65-8fba-a1e461d03ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:28.228980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97750ff-b412-4c65-8fba-a1e461d03ae7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:28.237979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 184/361] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:29.459951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eae53-9159-4918-be49-383dd7cd6e51 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:29.460472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eae53-9159-4918-be49-383dd7cd6e51 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:29.460472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eae53-9159-4918-be49-383dd7cd6e51 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:29.462104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 178/362] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:29.467049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455a78-cf7e-47ee-8682-2abf2bcdd9dd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:29.467454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455a78-cf7e-47ee-8682-2abf2bcdd9dd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:29.467619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33455a78-cf7e-47ee-8682-2abf2bcdd9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:29.494374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-33455a78-cf7e-47ee-8682-2abf2bcdd9dd None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:29.495584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-33455a78-cf7e-47ee-8682-2abf2bcdd9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:29.583823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 185/363] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:30.004573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03202-0647-4dad-8072-a14e4099faa9 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.004947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03202-0647-4dad-8072-a14e4099faa9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.005123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03202-0647-4dad-8072-a14e4099faa9 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.006745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 179/364] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:30.011640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ec54a-8350-4530-9fd1-29555e066f35 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.011933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ec54a-8350-4530-9fd1-29555e066f35 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.012214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ec54a-8350-4530-9fd1-29555e066f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.036656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-de6ec54a-8350-4530-9fd1-29555e066f35 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:30.037840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-de6ec54a-8350-4530-9fd1-29555e066f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:30.052426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:30.109611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd03202-0647-4dad-8072-a14e4099faa9 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:30.110451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 186/365] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:30.225093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:30.235418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd03202-0647-4dad-8072-a14e4099faa9 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:30.288570 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1756fe-9cea-4146-8dfe-7e0bda272744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:30.289203 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1756fe-9cea-4146-8dfe-7e0bda272744 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.289480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1756fe-9cea-4146-8dfe-7e0bda272744 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.289752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1756fe-9cea-4146-8dfe-7e0bda272744 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.304393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1756fe-9cea-4146-8dfe-7e0bda272744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ee1756fe-9cea-4146-8dfe-7e0bda272744 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:30.309205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:30.310063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:30.310862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 180/366] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:30.316984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ec54a-8350-4530-9fd1-29555e066f35 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:30.460691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1756fe-9cea-4146-8dfe-7e0bda272744 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:30.504933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ec54a-8350-4530-9fd1-29555e066f35 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:30.554638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8a5de-673f-4865-a46a-fb09527b895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:30.555414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8a5de-673f-4865-a46a-fb09527b895e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.555694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8a5de-673f-4865-a46a-fb09527b895e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.555962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8a5de-673f-4865-a46a-fb09527b895e None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.556730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8a5de-673f-4865-a46a-fb09527b895e None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:30.557030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8a5de-673f-4865-a46a-fb09527b895e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:30.558389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8a5de-673f-4865-a46a-fb09527b895e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:30.573289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 187/367] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:30.575842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1ff0-9128-48ef-9652-08f89fd661ea None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.576132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1ff0-9128-48ef-9652-08f89fd661ea None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.576404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1ff0-9128-48ef-9652-08f89fd661ea None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.578426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 188/368] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:30.579266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1ff0-9128-48ef-9652-08f89fd661ea None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:30.599400 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:30.614825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1756fe-9cea-4146-8dfe-7e0bda272744 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:30.653147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f40b7-6bbf-4edf-9277-1e10eb174b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:30.653887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f40b7-6bbf-4edf-9277-1e10eb174b85 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.654208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f40b7-6bbf-4edf-9277-1e10eb174b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.654578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f40b7-6bbf-4edf-9277-1e10eb174b85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.668908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f40b7-6bbf-4edf-9277-1e10eb174b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-135f40b7-6bbf-4edf-9277-1e10eb174b85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:30.674752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:30.675724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:30.676499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 181/369] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:30.682305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d33f3-8b96-4129-8518-66daddabc704 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.682305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d33f3-8b96-4129-8518-66daddabc704 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.682305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d33f3-8b96-4129-8518-66daddabc704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.699297 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f10d33f3-8b96-4129-8518-66daddabc704 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:30.700665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f10d33f3-8b96-4129-8518-66daddabc704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:30.706661 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1ff0-9128-48ef-9652-08f89fd661ea None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:30.709855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:30.755345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca3e2-6033-41d6-8b15-80ebfac89676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:30.755908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca3e2-6033-41d6-8b15-80ebfac89676 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.756287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca3e2-6033-41d6-8b15-80ebfac89676 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.756564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca3e2-6033-41d6-8b15-80ebfac89676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.770092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca3e2-6033-41d6-8b15-80ebfac89676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:30.772327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca3e2-6033-41d6-8b15-80ebfac89676 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:30.782010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 182/370] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:30.782904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d33f3-8b96-4129-8518-66daddabc704 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b86ca3e2-6033-41d6-8b15-80ebfac89676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:30.789979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:30.791994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:30.794008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:30.794008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:30.794008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:30.802541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 189/371] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:30.802541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23f13-4b48-44a0-8fe4-a37ab686227f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.802541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23f13-4b48-44a0-8fe4-a37ab686227f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.802541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23f13-4b48-44a0-8fe4-a37ab686227f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.802541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 190/372] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:30.803319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd23f13-4b48-44a0-8fe4-a37ab686227f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:30.898986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:30.908013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d33f3-8b96-4129-8518-66daddabc704 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:30.952578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d2b60-9153-4d78-96a2-70c4508bcfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:30.953249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2b60-9153-4d78-96a2-70c4508bcfdd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.953691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2b60-9153-4d78-96a2-70c4508bcfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.953972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2b60-9153-4d78-96a2-70c4508bcfdd None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.954136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd23f13-4b48-44a0-8fe4-a37ab686227f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:30.954678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d2b60-9153-4d78-96a2-70c4508bcfdd None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:30.954985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d2b60-9153-4d78-96a2-70c4508bcfdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:30.956665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d2b60-9153-4d78-96a2-70c4508bcfdd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:30.967639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 183/373] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:30.969553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fcdc4-a7e7-48af-87ed-6832b5454629 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.970325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fcdc4-a7e7-48af-87ed-6832b5454629 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.970644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fcdc4-a7e7-48af-87ed-6832b5454629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.980254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:30.996372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:30.997123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:30.997404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:30.997676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:30.998343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:30.998613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-972fcdc4-a7e7-48af-87ed-6832b5454629 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:30.998756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:31.000471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-972fcdc4-a7e7-48af-87ed-6832b5454629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:31.001386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:31.020599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 191/374] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:31.021437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.090139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 184/375] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:31.091175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fcdc4-a7e7-48af-87ed-6832b5454629 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.142091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c930d-cd0d-4c8f-8df2-a25dce9cfb99 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.167626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:31.181020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.181648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.181927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.182576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.194561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:31.196164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:31.206273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fcdc4-a7e7-48af-87ed-6832b5454629 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:31.211650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:31.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:31.218173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:31.218173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:31.218173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:31.218173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 192/376] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:31.218173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.244510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50285869-7c98-4608-9283-5f830ff6d9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.245318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50285869-7c98-4608-9283-5f830ff6d9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.245592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50285869-7c98-4608-9283-5f830ff6d9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.246196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50285869-7c98-4608-9283-5f830ff6d9a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.248519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:31.257157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50285869-7c98-4608-9283-5f830ff6d9a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:31.258632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50285869-7c98-4608-9283-5f830ff6d9a1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-50285869-7c98-4608-9283-5f830ff6d9a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:31.272969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:31.273863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 185/377] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9188a-063a-4dea-ae43-f84f2a6360ca None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.279968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9188a-063a-4dea-ae43-f84f2a6360ca None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.280813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9188a-063a-4dea-ae43-f84f2a6360ca None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.280813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 186/378] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:31.280813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9188a-063a-4dea-ae43-f84f2a6360ca None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.330200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527ce6a-f28a-4474-a5a9-c2428fb76c91 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.362546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcca14-8bac-4666-b1d8-bfefb86fbb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.363202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcca14-8bac-4666-b1d8-bfefb86fbb85 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.363475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcca14-8bac-4666-b1d8-bfefb86fbb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.363745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcca14-8bac-4666-b1d8-bfefb86fbb85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.374032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcca14-8bac-4666-b1d8-bfefb86fbb85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-91fcca14-8bac-4666-b1d8-bfefb86fbb85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:31.380329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:31.381215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 193/379] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:31.382719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcca14-8bac-4666-b1d8-bfefb86fbb85 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.392302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9188a-063a-4dea-ae43-f84f2a6360ca None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.418912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:31.428373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cbb80-c41e-48bb-a10e-986aa7330569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.428964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cbb80-c41e-48bb-a10e-986aa7330569 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.429240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cbb80-c41e-48bb-a10e-986aa7330569 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.429508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cbb80-c41e-48bb-a10e-986aa7330569 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.430138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cbb80-c41e-48bb-a10e-986aa7330569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:31.430437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cbb80-c41e-48bb-a10e-986aa7330569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:31.431842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cbb80-c41e-48bb-a10e-986aa7330569 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:31.443781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 187/380] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:31.444902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a72c-b5a4-4aff-891b-2cf4564db772 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.445182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a72c-b5a4-4aff-891b-2cf4564db772 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.445451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a72c-b5a4-4aff-891b-2cf4564db772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.463275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b838a72c-b5a4-4aff-891b-2cf4564db772 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:31.464469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b838a72c-b5a4-4aff-891b-2cf4564db772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:31.489998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcca14-8bac-4666-b1d8-bfefb86fbb85 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.514674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:31.523272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.523818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.524094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.524366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.525086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:31.525390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:31.526848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:31.533641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 188/381] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:31.534457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838a72c-b5a4-4aff-891b-2cf4564db772 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.564699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 194/382] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:31.565549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.650241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838a72c-b5a4-4aff-891b-2cf4564db772 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.665278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:31.674669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca667c-61a4-48d4-8201-19239ee43567 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.685110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389f022-5205-404a-8e82-4cc5b54b68b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.685737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f022-5205-404a-8e82-4cc5b54b68b0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.686018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f022-5205-404a-8e82-4cc5b54b68b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.686287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f022-5205-404a-8e82-4cc5b54b68b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.696842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389f022-5205-404a-8e82-4cc5b54b68b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-c389f022-5205-404a-8e82-4cc5b54b68b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:31.701649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:31.702494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:31.704208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 189/383] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:31.704844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389f022-5205-404a-8e82-4cc5b54b68b0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.720465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.721083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.721477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.721756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.722569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:31.722880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:31.724264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:31.737889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 195/384] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:31.738597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.753853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:31.814634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389f022-5205-404a-8e82-4cc5b54b68b0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.843327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e581b-3472-4dfc-bebe-a3dbe96f0d9f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.849324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.849939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.850211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.850481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.857297 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:31.858752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:31.870052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:31.871212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 190/385] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:31.872422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.880348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:31.881071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:31.881353 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:31.881630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:31.894652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:31.895760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:31.910645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:31.911545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:31.912408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:31.912408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:31.912408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:31.912408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 196/386] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:31.912629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:31.925340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:31.971049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4e308-a33a-46b5-b46d-cf5fa7623c5e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:31.973308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.005486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.006082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.006364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.006672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.007337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:32.007647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.009013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.017016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 191/387] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:32.017406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7e3ec-04eb-44e6-9353-8e62456a8911 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.017794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.051711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.052336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.052610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.052881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.063106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.064551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:32.078297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:32.079435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:32.080472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:32.080472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:32.080472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:32.080472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 197/388] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:32.080472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.124318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc484-6cba-4a7f-ba98-fada919f9447 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.141684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.157814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.158440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.158747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.159025 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.169894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.171401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.183451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a691-677e-420a-a121-91f62cb6dae4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:32.186409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:32.187626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:32.188491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:32.188491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:32.188491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:32.188491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 192/389] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:32.188699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.208088 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.217252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.217860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.218135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.218399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.219690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:32.219993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.221411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.239596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 198/390] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:32.240367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.287965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada43db1-639b-4bd5-9a1f-0c62684e5c9b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.320640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.321226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.321500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.321771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.322398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:32.322722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.324081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.335439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 193/391] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:32.336073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.343189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f1ef0-8ce9-4e91-9da1-c468a625a5ed None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.361189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.378215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.378886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.379155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.379430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.389470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.391599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:32.405922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:32.407504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:32.408549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:32.408549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:32.408549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:32.408549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 199/392] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:32.408802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.415542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.437030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b092e-2663-404e-b46e-acd68b2bad91 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.469648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.470240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.470542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.470818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.471475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:32.471773 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.473122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.485917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 194/393] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:32.486852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.507881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a41a-4196-49f1-b113-bd2eb34ea3e7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.541966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.542656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.542858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.543162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.543805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:32.544109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.545492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.558239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 200/394] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:32.559351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.588582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.588822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb67b7-671a-4cec-abd3-81c3211e7c18 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.622594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.623216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.623496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.623770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.631612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.636212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.637684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:32.651903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:32.652800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:32.653659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:32.653659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:32.653659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:32.653659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 195/395] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:32.653883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.664695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b2182-ce6c-4486-b82c-a0743a7143c6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.700883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.701328 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.701604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.701876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.708669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.710111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:32.721467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:32.722331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:32.723215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 201/396] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:32.723674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.752358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7e19-c34b-419a-b726-7c74053df6d3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.785425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.786026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.786313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.786618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.787256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:32.787563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.788920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.800901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 196/397] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:32.801668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.819024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.828985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bde6b-755c-4f0e-9296-1c26dc8dfdf1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.851717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:32.864765 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.865386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.865663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.865933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.873266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.874763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:32.887274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:32.888202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:32.889120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 202/398] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:32.889713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.907750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd7feb-9060-4021-a69d-4dc8dae67c94 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:32.941595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523c85-0684-4659-87ee-5d853063694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:32.942192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523c85-0684-4659-87ee-5d853063694f None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:32.942472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523c85-0684-4659-87ee-5d853063694f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:32.942776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523c85-0684-4659-87ee-5d853063694f None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:32.943415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78523c85-0684-4659-87ee-5d853063694f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:32.944874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78523c85-0684-4659-87ee-5d853063694f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:32.964153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 197/399] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:46:32 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:32.964952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523c85-0684-4659-87ee-5d853063694f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:32.995475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5d69a-0228-446b-92b5-46c9deeb1eb1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.035959 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.036929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.037210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.037485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.038155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:33.038456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.039904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.053680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 203/400] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:33.054564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.070056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:33.083732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523c85-0684-4659-87ee-5d853063694f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.096185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:33.128467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.128994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.129271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.129575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.130242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:33.130562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.131990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.152691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 198/401] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:33.153540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.178223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afa175-da5a-49c1-a2e5-5e96c585d1d9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.215179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.215809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.216088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.216362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.225796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.227510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:33.241007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:33.241929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 16:46:33.243260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:33.247107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 204/402] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:33.248293 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.270267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da2ebe-7cf2-46af-99dc-136e56341e6f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.306177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.306823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.307103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.307377 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.308104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:33.308422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.309847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.323607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:33.351970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 199/403] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Oct 10 16:46:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:33.351970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.364139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336aad-04f7-4969-99bc-b3c1940c8fc5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.378118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:33.402128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.402780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.403060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.403334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.410177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.411685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:33.423930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:33.424800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:33.425642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 205/404] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:33.426111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.460727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1588c46-c1fb-4987-868e-74bd832db6d3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.495342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0ee90-09c2-445b-85e3-a601a80068fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.496041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0ee90-09c2-445b-85e3-a601a80068fc None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.496280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0ee90-09c2-445b-85e3-a601a80068fc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.496556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0ee90-09c2-445b-85e3-a601a80068fc None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/78b5bbfc207243febee44e0d7cacb7b7/roles/69a9c12b055c4403bb98c1079613718c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.511671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0ee90-09c2-445b-85e3-a601a80068fc None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=78b5bbfc207243febee44e0d7cacb7b7, role_id=69a9c12b055c4403bb98c1079613718c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.513209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0ee90-09c2-445b-85e3-a601a80068fc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.526285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 200/405] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:33 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/78b5bbfc207243febee44e0d7cacb7b7/roles/69a9c12b055c4403bb98c1079613718c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:33.527119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0ee90-09c2-445b-85e3-a601a80068fc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.549005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4ce1e-14ce-429d-a29e-16dc3d1ca360 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.588416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:33.595083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.596135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.596523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.598021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.598803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:33.599130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.600640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.627779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 206/406] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Oct 10 16:46:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:33.628781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.629393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:33.666292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0ee90-09c2-445b-85e3-a601a80068fc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.722549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.723909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.724635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.725085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.740180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.742224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.743504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bd592-f6e7-44a2-aeb9-4937d9ed134d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:33.761635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:33.762636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:33.763534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:33.763534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:33.763534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:33.763534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 201/407] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:33.763534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.789023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.790086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.790614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.791162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.792061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:33.792590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.794429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.816065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 207/408] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:33.817397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.880599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:33.887657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eeeb6-4665-454e-bedd-6b3ad17fda4f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.919710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:33.931099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.932111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.932620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.933103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.945974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.947740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:33.952356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3addc2e-6967-4e09-bd54-a120a1c805d6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:33.964977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:33.965894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:33.966775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:33.966775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:33.966775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:33.969781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 202/409] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:33.970917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:33.995009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:33.995616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:33.995895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:33.996158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:33.996806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:33.997104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:33.998470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:34.015182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 208/410] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:34.016589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:34.088886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00804-cc71-45bb-9a52-479976742e28 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:34.127733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17391dd-2d3e-4507-b38b-e8b202628f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:34.128393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17391dd-2d3e-4507-b38b-e8b202628f7c None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:34.128666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17391dd-2d3e-4507-b38b-e8b202628f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:34.128937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17391dd-2d3e-4507-b38b-e8b202628f7c None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/ede14ff816494505b20faba615bc5026/roles/69a9c12b055c4403bb98c1079613718c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:34.144424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17391dd-2d3e-4507-b38b-e8b202628f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=ede14ff816494505b20faba615bc5026, role_id=69a9c12b055c4403bb98c1079613718c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:34.145041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620a68-090f-4d3d-83b1-ce123339028e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:34.145900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17391dd-2d3e-4507-b38b-e8b202628f7c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:34.158215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:34.162356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 203/411] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:33 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/ede14ff816494505b20faba615bc5026/roles/69a9c12b055c4403bb98c1079613718c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:34.163400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17391dd-2d3e-4507-b38b-e8b202628f7c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:34.190068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:34.190965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:34.191445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:34.191868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:34.192922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:34.193387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:34.195962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:34.211100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 209/412] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:34.219405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:34.220315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:34.296670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17391dd-2d3e-4507-b38b-e8b202628f7c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:34.353252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b1b3-0830-4ec9-9366-a8d1126fa730 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:34.385432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:34.386181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:34.386466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:34.386763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:34.396437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:34.397075 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:34.397408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:34.397689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:34.404152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:34.405639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:34.406687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:34.407927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:34.420115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:34.420966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:34.422477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:34.422477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:34.422477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:34.422477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:34.422477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:34.422477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:34.422477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:34.422477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:34.422927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:34.423680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:34.424533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 210/413] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:34.430553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 204/414] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:34.431686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:34.433973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:34.466641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:34.576794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:34.582535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee05e0-9557-45c5-9aa7-b5f307e8d077 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:34.603027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb72ab-cd52-4d3c-ab8d-d517fd426a21 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:34.649306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:34.649914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:34.650194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:34.650466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:34.651195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:34.651497 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:34.653463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:34.667286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 211/415] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:34.673315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:34.673441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:34.673935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:34.674213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:34.674483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:34.675214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:34.675520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:34.677237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:34.703691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 205/416] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:34.711678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:34.841526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:34.847359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d4d1-23d7-4b50-b66d-a3bc494d50d5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:34.857785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6020-1a4e-4dd8-b522-c3ec82a10f15 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:34.910017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65763ff-cfbe-495b-84a6-48470590577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:34.911118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65763ff-cfbe-495b-84a6-48470590577e None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:34.911624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65763ff-cfbe-495b-84a6-48470590577e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:34.912103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65763ff-cfbe-495b-84a6-48470590577e None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/3dc38841128043d0bd618275c77bbf5b/roles/69a9c12b055c4403bb98c1079613718c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:34.929936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65763ff-cfbe-495b-84a6-48470590577e None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=3dc38841128043d0bd618275c77bbf5b, role_id=69a9c12b055c4403bb98c1079613718c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:34.931770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65763ff-cfbe-495b-84a6-48470590577e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:34.941620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:34.945624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c2182-18ee-441a-bf9a-fde4db47eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:34.946302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c2182-18ee-441a-bf9a-fde4db47eede None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:34.946604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c2182-18ee-441a-bf9a-fde4db47eede None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:34.946884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c2182-18ee-441a-bf9a-fde4db47eede None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/b3d805106909465abd09c0daf5ecc1cc/roles/69a9c12b055c4403bb98c1079613718c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:34.948204 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 206/417] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:34 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/3dc38841128043d0bd618275c77bbf5b/roles/69a9c12b055c4403bb98c1079613718c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:46:34.991487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c2182-18ee-441a-bf9a-fde4db47eede None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=b3d805106909465abd09c0daf5ecc1cc, role_id=69a9c12b055c4403bb98c1079613718c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:34.992970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c2182-18ee-441a-bf9a-fde4db47eede None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:35.024732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 212/418] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:34 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/b3d805106909465abd09c0daf5ecc1cc/roles/69a9c12b055c4403bb98c1079613718c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:46:35.226930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aff12-988a-44b1-9d7a-7d0dfc5aaa6f None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:35.227290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aff12-988a-44b1-9d7a-7d0dfc5aaa6f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:35.227479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aff12-988a-44b1-9d7a-7d0dfc5aaa6f None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:35.228859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 207/419] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:35.234861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548e308-9f7c-4c00-aa28-d4ac661931b1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:35.235066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548e308-9f7c-4c00-aa28-d4ac661931b1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:35.235306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548e308-9f7c-4c00-aa28-d4ac661931b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:35.255498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c548e308-9f7c-4c00-aa28-d4ac661931b1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:35.256687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c548e308-9f7c-4c00-aa28-d4ac661931b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:35.334614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 213/420] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:35.603947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aff12-988a-44b1-9d7a-7d0dfc5aaa6f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:35.744211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aff12-988a-44b1-9d7a-7d0dfc5aaa6f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:35.800680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9090-9cf4-4b6e-bf9c-8e01eff655f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:35.801324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9090-9cf4-4b6e-bf9c-8e01eff655f0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:35.801606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9090-9cf4-4b6e-bf9c-8e01eff655f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:35.801878 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9090-9cf4-4b6e-bf9c-8e01eff655f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:35.818030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f9090-9cf4-4b6e-bf9c-8e01eff655f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-353f9090-9cf4-4b6e-bf9c-8e01eff655f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:35.823031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:35.823905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:35.824764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 208/421] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:35.830467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548e308-9f7c-4c00-aa28-d4ac661931b1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:35.936869 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:35.986299 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548e308-9f7c-4c00-aa28-d4ac661931b1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:36.026134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:36.026806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:36.027086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:36.027361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:36.028040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:36.028344 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:36.029857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:36.039082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 214/422] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:36.047667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9090-9cf4-4b6e-bf9c-8e01eff655f0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:36.122749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:36.184278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9090-9cf4-4b6e-bf9c-8e01eff655f0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:36.231242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:36.231879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:36.232157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:36.232425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:36.245981 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:36.247455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:36.268928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:36.269874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:36.270744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:36.270744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:36.270744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:36.270744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 209/423] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:36.275947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:36.419392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3eb6b-86e1-465f-9169-c22c4ccce7dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:36.450490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:36.458132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247229a2-f43a-49bf-9431-e60f12f40ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:36.458820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247229a2-f43a-49bf-9431-e60f12f40ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:36.459111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247229a2-f43a-49bf-9431-e60f12f40ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:36.459390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247229a2-f43a-49bf-9431-e60f12f40ae0 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:36.460040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247229a2-f43a-49bf-9431-e60f12f40ae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:36.460347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247229a2-f43a-49bf-9431-e60f12f40ae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:36.461906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247229a2-f43a-49bf-9431-e60f12f40ae0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:36.475642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 215/424] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:36.481026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:36.484086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16dc4-7090-4d1e-afb1-25673adbbbf2 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:36.484815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16dc4-7090-4d1e-afb1-25673adbbbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:36.485360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16dc4-7090-4d1e-afb1-25673adbbbf2 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:36.487151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 216/425] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:36.492583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601a95-3b12-4b2a-baf1-043f1db88397 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:36.493098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601a95-3b12-4b2a-baf1-043f1db88397 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:36.493603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601a95-3b12-4b2a-baf1-043f1db88397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:36.513178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-41601a95-3b12-4b2a-baf1-043f1db88397 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:36.514717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-41601a95-3b12-4b2a-baf1-043f1db88397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:36.643580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 217/426] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:36.658908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09361adc-3b02-4080-8f36-81b44d7b3280 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:36.673297 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:36.704246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:36.704790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:36.705067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:36.705339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:36.715393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:36.716840 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:36.730618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:36.731559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 16:46:36.732430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:36.737587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 210/427] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:36.738969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601a95-3b12-4b2a-baf1-043f1db88397 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:36.843332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601a95-3b12-4b2a-baf1-043f1db88397 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:36.875280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:36.887825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ac348-b860-4650-ba8d-dc048443c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:36.888956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ac348-b860-4650-ba8d-dc048443c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:36.889654 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ac348-b860-4650-ba8d-dc048443c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:36.891015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ac348-b860-4650-ba8d-dc048443c0a0 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:36.891793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ac348-b860-4650-ba8d-dc048443c0a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:36.892101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ac348-b860-4650-ba8d-dc048443c0a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:36.899950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ac348-b860-4650-ba8d-dc048443c0a0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:36.920899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 218/428] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Oct 10 16:46:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:36.925967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.052598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5f5d-aa56-4283-b1c2-a834b3fb7b5c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:37.070248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206e46-49e7-441e-a195-6e7d7026af64 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.070584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206e46-49e7-441e-a195-6e7d7026af64 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.070831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206e46-49e7-441e-a195-6e7d7026af64 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.073207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 219/429] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:37.077062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6347f8-3a86-4312-af9e-2b0d43522a4b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.077346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6347f8-3a86-4312-af9e-2b0d43522a4b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.077658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6347f8-3a86-4312-af9e-2b0d43522a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.094176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:37.095170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.095644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.096121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.107423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:37.109647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:37.115490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-af6347f8-3a86-4312-af9e-2b0d43522a4b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:37.116860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-af6347f8-3a86-4312-af9e-2b0d43522a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:37.126549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:37.127714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:37.128533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:37.128533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:37.128533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:37.128533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 211/430] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:37.132058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.161361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:37.215792 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 220/431] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:37.217311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6347f8-3a86-4312-af9e-2b0d43522a4b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.284100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570bae-b1be-4e9d-80c0-967c54d97387 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:37.334251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6347f8-3a86-4312-af9e-2b0d43522a4b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:37.345777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:37.366193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:37.366856 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.367135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.367410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.368068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:37.368371 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:37.369772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:37.392207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a4a48-95a2-4d8a-b956-13e0801bb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:37.392866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4a48-95a2-4d8a-b956-13e0801bb3db None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.393145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4a48-95a2-4d8a-b956-13e0801bb3db None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.393423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4a48-95a2-4d8a-b956-13e0801bb3db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.394188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 212/432] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:37.399881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.431480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a4a48-95a2-4d8a-b956-13e0801bb3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3d2a4a48-95a2-4d8a-b956-13e0801bb3db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:37.436283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:37.437186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:37.438084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 221/433] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:37.447492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a4a48-95a2-4d8a-b956-13e0801bb3db None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.504775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:37.530504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd00f4c-a0f9-41e2-9592-809958e09e82 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:37.568488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e26c8-f9a1-4380-8d95-257267ff11f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:37.569490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e26c8-f9a1-4380-8d95-257267ff11f4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.569915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e26c8-f9a1-4380-8d95-257267ff11f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.570182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e26c8-f9a1-4380-8d95-257267ff11f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.577588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e26c8-f9a1-4380-8d95-257267ff11f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:37.579269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e26c8-f9a1-4380-8d95-257267ff11f4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-db7e26c8-f9a1-4380-8d95-257267ff11f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:37.591018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:37.591853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:37.592704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:37.592704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:37.592704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:37.592704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:37.592704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:37.592704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:37.592704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:37.592704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:37.593126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a4a48-95a2-4d8a-b956-13e0801bb3db None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:37.593703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 213/434] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:37.594283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634713ef-0e92-4d97-9034-3da8fac99e76 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.594378 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634713ef-0e92-4d97-9034-3da8fac99e76 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.594631 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634713ef-0e92-4d97-9034-3da8fac99e76 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.600098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 214/435] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:37.600098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634713ef-0e92-4d97-9034-3da8fac99e76 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.636022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:37.637658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.638121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.638591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.639420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:37.639917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:37.642197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:37.652952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 222/436] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:37.654488 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.697077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:37.703961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634713ef-0e92-4d97-9034-3da8fac99e76 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:37.737729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43046-15c9-427c-b9b1-24227b7bb573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:37.738355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43046-15c9-427c-b9b1-24227b7bb573 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.738676 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43046-15c9-427c-b9b1-24227b7bb573 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.738950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43046-15c9-427c-b9b1-24227b7bb573 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.750817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43046-15c9-427c-b9b1-24227b7bb573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-65d43046-15c9-427c-b9b1-24227b7bb573 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:37.756595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:37.757589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:37.758436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 215/437] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:37.759122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0b77-f0ca-4f5f-a964-c0305f5352db None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.759544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0b77-f0ca-4f5f-a964-c0305f5352db None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.759544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0b77-f0ca-4f5f-a964-c0305f5352db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.766287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:37.778974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-de6b0b77-f0ca-4f5f-a964-c0305f5352db None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:37.780317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-de6b0b77-f0ca-4f5f-a964-c0305f5352db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:37.788414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9545842-f062-4ccf-9e73-60e26116c5dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:37.826262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:37.826892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:37.827169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:37.827449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:37.828761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:37.829070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:37.830502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:37.843100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 223/438] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:37.843930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.866287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 216/439] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:37.867693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0b77-f0ca-4f5f-a964-c0305f5352db None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:37.953372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:37.963755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63087-1819-4d9f-a173-8b091ec77dd6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:37.978411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0b77-f0ca-4f5f-a964-c0305f5352db None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.000442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.000917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.001221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.001493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.011257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:38.011719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.013167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.017961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9ac72-84a9-4a0b-9852-4de067efd81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.018665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ac72-84a9-4a0b-9852-4de067efd81f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.018923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ac72-84a9-4a0b-9852-4de067efd81f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.019199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ac72-84a9-4a0b-9852-4de067efd81f None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.019864 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9ac72-84a9-4a0b-9852-4de067efd81f None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:38.020587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9ac72-84a9-4a0b-9852-4de067efd81f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.022352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9ac72-84a9-4a0b-9852-4de067efd81f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:38.027889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:38.028812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:38.029655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:38.029655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:38.029655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:38.029655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 224/440] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:38.029877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.041430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 217/441] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:38.041430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029401-8f3a-40bc-829a-222eadeee8da None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.041430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029401-8f3a-40bc-829a-222eadeee8da None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.041430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91029401-8f3a-40bc-829a-222eadeee8da None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.041430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 218/442] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:38.041430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91029401-8f3a-40bc-829a-222eadeee8da None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.138092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff083c-4426-4607-b80b-00cff4367e45 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.146191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91029401-8f3a-40bc-829a-222eadeee8da None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.172938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3600e3f-31d1-4990-9984-1d5ea559611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.173586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3600e3f-31d1-4990-9984-1d5ea559611d None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.173859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3600e3f-31d1-4990-9984-1d5ea559611d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.174128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3600e3f-31d1-4990-9984-1d5ea559611d None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/7ee9a6828d334114bb3a7ae391960bf0/roles/69a9c12b055c4403bb98c1079613718c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.180120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.180716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.180996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.181270 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.181906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:38.182213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.183609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.186096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:38.189473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3600e3f-31d1-4990-9984-1d5ea559611d None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=7ee9a6828d334114bb3a7ae391960bf0, role_id=69a9c12b055c4403bb98c1079613718c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.191262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3600e3f-31d1-4990-9984-1d5ea559611d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.195441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 219/443] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:38.196721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.204081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 225/444] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:38 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/7ee9a6828d334114bb3a7ae391960bf0/roles/69a9c12b055c4403bb98c1079613718c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:38.205453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237c3e-0409-4814-9a95-aadaa8c64358 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.205740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237c3e-0409-4814-9a95-aadaa8c64358 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.206010 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237c3e-0409-4814-9a95-aadaa8c64358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.225689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7b237c3e-0409-4814-9a95-aadaa8c64358 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:38.226937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7b237c3e-0409-4814-9a95-aadaa8c64358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:38.274599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:38.304721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 226/445] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:38.315617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237c3e-0409-4814-9a95-aadaa8c64358 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.330014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76936453-53a5-4be1-98a3-9bd039f148c7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.370260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.371090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.371461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.371906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.387233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.388234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:38.405744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:38.407416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:38.408463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:38.408463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:38.408463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:38.409443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 220/446] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:38.414542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.444473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237c3e-0409-4814-9a95-aadaa8c64358 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.475346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:38.492193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458acd0-382d-4dfb-9417-393747dd6973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.493234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458acd0-382d-4dfb-9417-393747dd6973 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.493617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458acd0-382d-4dfb-9417-393747dd6973 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.494459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458acd0-382d-4dfb-9417-393747dd6973 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.515548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458acd0-382d-4dfb-9417-393747dd6973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1458acd0-382d-4dfb-9417-393747dd6973 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:38.521778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:38.522914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:38.523879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 227/447] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:38.524674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458acd0-382d-4dfb-9417-393747dd6973 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.546130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecdf68-b717-48eb-ad66-89bb5b419b70 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.555124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:38.587243 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.587909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.588183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.588450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.597122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.598760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:38.611795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:38.612716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 221/448] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:38.614293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.658601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458acd0-382d-4dfb-9417-393747dd6973 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.697384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.698088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.698409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.698712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.699393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:38.699692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.701344 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.718630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 228/449] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:38.718630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.722340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa87-5a01-4c3e-beac-d65d00975f82 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.757548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.758197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.758415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.758711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.759517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:38.759814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.761344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.762704 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:38.775591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 222/450] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:38.776776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.806901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:38.826214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d68800-1fa6-4bc0-a1c2-dd9d0ef917fa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.864433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca07fe-ebb7-4346-a61a-b482f5f0758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.865485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca07fe-ebb7-4346-a61a-b482f5f0758c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.865485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca07fe-ebb7-4346-a61a-b482f5f0758c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.865681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca07fe-ebb7-4346-a61a-b482f5f0758c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.877978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca07fe-ebb7-4346-a61a-b482f5f0758c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:38.883518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d5772-b51a-4bd6-812a-849bce7b9b9e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-98ca07fe-ebb7-4346-a61a-b482f5f0758c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:38.884247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:38.885103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:38.885965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 229/451] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:38.886659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca07fe-ebb7-4346-a61a-b482f5f0758c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:38.929848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:38.930491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:38.930656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:38.930928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:38.931819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:38.931943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:38.933341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:38.955795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 223/452] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:38.955795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.003336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca07fe-ebb7-4346-a61a-b482f5f0758c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.005001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.041752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.042072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.042687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.042964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.043235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.051668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.053097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.059556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2fe97-4cfe-45af-8192-b65d2dd1b79b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:39.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:39.066563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 230/453] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:39.068020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.099309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.099941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.100215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.100545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.112737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.114232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:39.130328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:39.131357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:39.132192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:39.132192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:39.132192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:39.132192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 224/454] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:39.132192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.184823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95547f12-2254-4a5b-bfef-a18f8e810763 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.225060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.225810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.226088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.226360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.227045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:39.227348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.228715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.236834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f716ee-248b-47a8-bd91-52355fbc475d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.237056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 231/455] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:39.241898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.267663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.277486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2596-7ffe-4341-8d35-cfccd60fb899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.278082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2596-7ffe-4341-8d35-cfccd60fb899 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.278358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2596-7ffe-4341-8d35-cfccd60fb899 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.278654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2596-7ffe-4341-8d35-cfccd60fb899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.287686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.348645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2596-7ffe-4341-8d35-cfccd60fb899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.350330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2596-7ffe-4341-8d35-cfccd60fb899 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.353457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c0f3e-5b7d-4f3e-a199-240ef6936dfd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.387958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.388558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.388833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.389100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.389815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:39.390887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.392315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.411090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 232/456] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:39.412231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.467471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 225/457] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:39.468341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2596-7ffe-4341-8d35-cfccd60fb899 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.508270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.510226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.530024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb002c-9069-4879-8819-193b3ae4fb89 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.567658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.568349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.568791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.569131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.569943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:39.570318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.571777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.572263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2596-7ffe-4341-8d35-cfccd60fb899 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.589185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 233/458] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:39.589185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.611753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.612467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.612812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.613155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.624084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.626323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:39.641129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:39.642183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:39.643080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:39.643080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:39.643080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:39.643080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 226/459] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:39.643080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.704377 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63982c-90b8-4648-bc3a-cc6b75b87db7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.738498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.743087 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67ccad-0516-4a53-a5e5-9723d88ef473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.743684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67ccad-0516-4a53-a5e5-9723d88ef473 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.743965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67ccad-0516-4a53-a5e5-9723d88ef473 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.744237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67ccad-0516-4a53-a5e5-9723d88ef473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.750450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d75e-8419-45fb-a0d7-fd6727f48fc9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.758875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.786157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.786810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.787084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.787417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.799917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.801367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:39.816692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:39.817621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:39.818453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:39.818453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:39.818453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:39.818453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 227/460] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:39.818694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.820973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67ccad-0516-4a53-a5e5-9723d88ef473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.822462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67ccad-0516-4a53-a5e5-9723d88ef473 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.927064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bea0c-9acc-4a99-b596-9dd900e97e64 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:39.941793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 234/461] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:39.943435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67ccad-0516-4a53-a5e5-9723d88ef473 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.967072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:39.967919 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:39.968944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:39.969292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:39.978354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:39.980335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:39.989221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:39.991591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:39.992811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 228/462] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:39.993697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:39.997321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.056389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67ccad-0516-4a53-a5e5-9723d88ef473 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.095582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.096185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.096467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.096738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.097375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:40.097677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.098188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cfd2-7bed-4e18-b496-4f90b27ba766 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.099155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.118092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 235/463] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:40.118092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.133856 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.134470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.134790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.135065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.135709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:40.136014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.137386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.150462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 229/464] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:40.151403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.214619 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.238424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed19230-32c8-4a14-b25b-6042d412f93d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.240169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.258129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39553b1-7f9b-430c-94db-7e1786536808 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.277557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.278209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.278488 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.278794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.291524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.292999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.298768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.299609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.300087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.300496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.301383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:40.301686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.303309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:40.309810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:40.310740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:40.311588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:40.311588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:40.311588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:40.311588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 236/465] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:40.312406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.333027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 230/466] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:40.333027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.423489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31169a1c-67ba-46ae-af5d-2cef719f2c7a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.434614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f94fa2-64f6-4e65-a934-3e0e14d255cc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.454042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.456227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.456966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.457238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.457503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.464769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.466193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.468851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.469415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.469701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.469973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.476830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.478290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:40.478634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:40.479674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 237/467] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:40.480769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:40.495489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:40.496412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:40.497230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 231/468] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:40.497690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.499203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.584449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b09b5-0602-493b-830e-0f2741e67cfe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.597555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ae8b6-af33-4f91-80e1-b36743a524b7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.625586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3964c-d416-4557-923c-7cd943b900f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.626190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3964c-d416-4557-923c-7cd943b900f6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.626465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3964c-d416-4557-923c-7cd943b900f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.627018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3964c-d416-4557-923c-7cd943b900f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.627653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3964c-d416-4557-923c-7cd943b900f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:40.627948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3964c-d416-4557-923c-7cd943b900f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.629303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3964c-d416-4557-923c-7cd943b900f6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.632843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db399658-5505-4501-bb13-2fdc660a2397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.633440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db399658-5505-4501-bb13-2fdc660a2397 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.633719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db399658-5505-4501-bb13-2fdc660a2397 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.633990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db399658-5505-4501-bb13-2fdc660a2397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.641641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 238/469] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:40.643207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576d09-bb4e-4f06-afda-eda7122a31f5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.643504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576d09-bb4e-4f06-afda-eda7122a31f5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.643780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0576d09-bb4e-4f06-afda-eda7122a31f5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.645128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 239/470] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:40.645748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0576d09-bb4e-4f06-afda-eda7122a31f5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.683833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.703622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db399658-5505-4501-bb13-2fdc660a2397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.705175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db399658-5505-4501-bb13-2fdc660a2397 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.723432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.749857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0576d09-bb4e-4f06-afda-eda7122a31f5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.786096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95ca43-478a-4768-9c02-05ff7c254313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.786728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ca43-478a-4768-9c02-05ff7c254313 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.787010 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ca43-478a-4768-9c02-05ff7c254313 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.787284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ca43-478a-4768-9c02-05ff7c254313 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.788006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95ca43-478a-4768-9c02-05ff7c254313 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:40.788310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95ca43-478a-4768-9c02-05ff7c254313 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.789778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95ca43-478a-4768-9c02-05ff7c254313 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.803885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 232/471] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:40.804909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db399658-5505-4501-bb13-2fdc660a2397 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.813415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 240/472] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:40.814719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a6c8-5163-4ee4-b1bc-5a2180536756 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.815007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a6c8-5163-4ee4-b1bc-5a2180536756 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.815281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9a6c8-5163-4ee4-b1bc-5a2180536756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.834032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-28b9a6c8-5163-4ee4-b1bc-5a2180536756 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:40.835239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-28b9a6c8-5163-4ee4-b1bc-5a2180536756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:40.886217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.902719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 241/473] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:40.903572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9a6c8-5163-4ee4-b1bc-5a2180536756 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:40.917941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db399658-5505-4501-bb13-2fdc660a2397 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:40.954207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:40.954843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:40.955127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:40.955449 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:40.956260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:40.956565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:40.958042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:40.964169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:40.973240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 233/474] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:40.974168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.014451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9a6c8-5163-4ee4-b1bc-5a2180536756 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.051936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.052604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.052881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.053149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.059940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.061372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:41.073459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:41.074311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:41.075184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 242/475] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:41.075646 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.085557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82246e4-8a72-4a08-967c-69e608a049dc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.120188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.120812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.121094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.121368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.131110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:41.133260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.135017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:41.150280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:41.151199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:41.152030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:41.152030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:41.152030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:41.152030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 234/476] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:41.152244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.193267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a891-1697-4970-8d75-0afacffb919a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.215708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:41.228236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90bc8d-f11e-46fb-bc16-97dcfd676323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.228841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bc8d-f11e-46fb-bc16-97dcfd676323 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.229124 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bc8d-f11e-46fb-bc16-97dcfd676323 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.229398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bc8d-f11e-46fb-bc16-97dcfd676323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.252060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f55af-21b0-4d20-8e3e-ff1242753a77 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.285391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.285914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.286905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.287190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.287908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] RBAC: Adding query filter params (role.id=69a9c12b055c4403bb98c1079613718c, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=78b5bbfc207243febee44e0d7cacb7b7) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:41.288213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.289639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.295402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 235/477] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/role_assignments?user.id=78b5bbfc207243febee44e0d7cacb7b7&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=69a9c12b055c4403bb98c1079613718c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:41.296867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.299175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90bc8d-f11e-46fb-bc16-97dcfd676323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.300857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90bc8d-f11e-46fb-bc16-97dcfd676323 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.361862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:41.413655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06219a11-5cf1-4e9c-8716-cb7eb3ab3a79 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.425851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 243/478] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:41.425851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90bc8d-f11e-46fb-bc16-97dcfd676323 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.452063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:41.454044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.454738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.455059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.455368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.456074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:41.456381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.457853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.471703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 236/479] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:41.472053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.542996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90bc8d-f11e-46fb-bc16-97dcfd676323 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.578657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.579313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.579599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.579877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.580511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:41.580815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.582199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.586740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9bee6-e61a-4691-bcd2-a805d5b2d9d1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.593453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 244/480] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:41.594276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.608135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:41.629561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec3a0e-323b-4f98-b993-82db4bbae479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.630408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec3a0e-323b-4f98-b993-82db4bbae479 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.630725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec3a0e-323b-4f98-b993-82db4bbae479 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.631003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec3a0e-323b-4f98-b993-82db4bbae479 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.642400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec3a0e-323b-4f98-b993-82db4bbae479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-52ec3a0e-323b-4f98-b993-82db4bbae479 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:41.647331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:41.648407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:41.649426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 237/481] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:41.653850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec3a0e-323b-4f98-b993-82db4bbae479 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.690342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:41.710539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482566a5-b2cb-47e5-8df8-f8338848720e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.745420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.746055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.746337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.746642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.757950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.759427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.762977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec3a0e-323b-4f98-b993-82db4bbae479 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:41.773993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:41.774974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:41.775811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:41.775811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:41.775811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:41.775811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 245/482] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:41.776039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.809164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.809681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.809959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.810222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.810984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] RBAC: Adding query filter params (role.id=69a9c12b055c4403bb98c1079613718c, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=ede14ff816494505b20faba615bc5026) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:41.811292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.813085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.830551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 238/483] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/role_assignments?user.id=ede14ff816494505b20faba615bc5026&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=69a9c12b055c4403bb98c1079613718c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:41.830551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.894553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:41.901096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8ea62-369d-43f4-901f-854f33b82b47 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:41.940802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:41.941450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:41.941740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:41.942016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:41.944344 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:41.950639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:41.954102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:41.966888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:41.968437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:41.969345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:41.969345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:41.969345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:41.969345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:41.969345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:41.969345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:41.969345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:41.969345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:41.974997 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 246/484] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:41.976159 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:41.988711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a253e3-0a3b-4a66-8ed0-0a3caef5039f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.040091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.041196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.041641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.042011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.042806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:42.043210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.045138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.055473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 239/485] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:42.056491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:42.101924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d40b7e-e6a2-4994-8cdd-1c40086154a4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.146231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.147106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.147540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.147817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.148469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:42.148776 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.150150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.164991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 247/486] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:42.165840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:42.175872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d800e-40b7-42da-b1b1-c4b2f05ba0be None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.179560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:42.223782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.224896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.225887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.226344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.227495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:42.227953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.230214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.235933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:42.250649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 240/487] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:42.251985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:42.292153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4260c-198d-4b40-8b77-aa79401605b1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.331352 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.332255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.332640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.333015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.348564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.350298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:42.366883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:42.368004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:42.369032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:42.369032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:42.369032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:42.370465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 248/488] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:42.371460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:42.377576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50d1b3-7e9e-42cf-9346-fe7f5a693bc7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.426738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.427674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.428115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.428543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.435861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.438301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:42.450261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:42.451287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:42.452349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:42.452349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:42.452349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:42.452349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:42.452349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:42.452349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:42.452349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:42.452349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:42.454562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 241/489] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:42.455567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:42.483243 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:42.498741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf80d-b479-4874-a0b6-326eb6089d97 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.508494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:42.540025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.540985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.541415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.541835 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.542748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] RBAC: Adding query filter params (role.id=69a9c12b055c4403bb98c1079613718c, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=b3d805106909465abd09c0daf5ecc1cc) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:42.543233 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.547065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.555105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 249/490] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:42 2022] GET /identity/v3/role_assignments?user.id=b3d805106909465abd09c0daf5ecc1cc&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=69a9c12b055c4403bb98c1079613718c => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:42.556168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:42.619784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb47205-dbe2-4578-8c58-d6629bf81cc6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.704607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.705282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.705562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.705831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.706482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:42.706813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.708214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.735722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 242/491] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:42.741230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:42.758481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454525d-2449-486c-ab1c-a53bc25d77c2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.805995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.807324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.807953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.808520 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.809435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:42.809931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.811641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.829196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 250/492] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:42.836007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:42.860792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:42.869437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:42.889752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc0089-29a9-4444-8dd7-6a5b8eff59e1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.945482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:42.946351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:42.946658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:42.948224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:42.963719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:42.965211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:42.988023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfafc96-5094-430c-b605-e2159bca0973 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:42.989596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:42.990485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 16:46:42.991429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:42.992228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 243/493] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:43.003283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:43.058275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2372-6c31-4612-a679-984807b028dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:43.058919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2372-6c31-4612-a679-984807b028dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:43.059196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2372-6c31-4612-a679-984807b028dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:43.059468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2372-6c31-4612-a679-984807b028dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:43.060206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b2372-6c31-4612-a679-984807b028dc None admin] RBAC: Adding query filter params (role.id=69a9c12b055c4403bb98c1079613718c, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=3dc38841128043d0bd618275c77bbf5b) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:43.060515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b2372-6c31-4612-a679-984807b028dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:43.062563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b2372-6c31-4612-a679-984807b028dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:43.079539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 251/494] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:42 2022] GET /identity/v3/role_assignments?user.id=3dc38841128043d0bd618275c77bbf5b&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=69a9c12b055c4403bb98c1079613718c => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:43.204834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89dce-696b-4bbc-bad1-0e799a31e9ec None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:43.255082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:43.255700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:43.255976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:43.256247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:43.256988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:43.257293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:43.258778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:43.289613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 244/495] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Oct 10 16:46:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:43.289899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:43.295939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2372-6c31-4612-a679-984807b028dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:43.403448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:43.410553 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2372-6c31-4612-a679-984807b028dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:43.447675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726023e-88c1-490f-aaed-6d8dc8ac3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:43.448284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726023e-88c1-490f-aaed-6d8dc8ac3756 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:43.448572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726023e-88c1-490f-aaed-6d8dc8ac3756 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:43.448844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726023e-88c1-490f-aaed-6d8dc8ac3756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:43.522498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726023e-88c1-490f-aaed-6d8dc8ac3756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:43.523931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726023e-88c1-490f-aaed-6d8dc8ac3756 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:43.628306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:43.637950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 252/496] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 16:46:43.644848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:43.684239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d70c1-99d6-4479-84be-617456786c59 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:43.684561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d70c1-99d6-4479-84be-617456786c59 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:43.684792 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d70c1-99d6-4479-84be-617456786c59 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:43.686448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 253/497] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:43.692819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808510-4178-4ed9-8e54-e6ccef0f8818 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:43.693110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808510-4178-4ed9-8e54-e6ccef0f8818 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:43.693383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808510-4178-4ed9-8e54-e6ccef0f8818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:43.727746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d2808510-4178-4ed9-8e54-e6ccef0f8818 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:43.728982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d2808510-4178-4ed9-8e54-e6ccef0f8818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:43.824557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6445-2e77-4f21-9d67-415d28ec467b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:43.828151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 254/498] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:43.888636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:43.891363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:43.891649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:43.891920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:43.909407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:43.910890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:43.931666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:43.933939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:43.936160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:43.936160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:43.936160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:43.936160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 245/499] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:43.938703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2808510-4178-4ed9-8e54-e6ccef0f8818 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:44.082944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2808510-4178-4ed9-8e54-e6ccef0f8818 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:44.122021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:44.135431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:44.136271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.136754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.137291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.137956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:44.138265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:44.139668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:44.159823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 255/500] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:44.165209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:44.223498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:44.267106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:44.354450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22bea-ded5-4373-b21a-4ee7f0614979 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:44.359760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e6079-11f3-48f8-b0d8-1fefa0d7678b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:44.423855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de8e5-bd34-44ef-bbac-98c5a23d3d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:44.424496 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de8e5-bd34-44ef-bbac-98c5a23d3d9c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.424773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de8e5-bd34-44ef-bbac-98c5a23d3d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.425044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de8e5-bd34-44ef-bbac-98c5a23d3d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.429451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:44.430082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.430360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.430660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.443549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:44.445017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:44.449896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73de8e5-bd34-44ef-bbac-98c5a23d3d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f73de8e5-bd34-44ef-bbac-98c5a23d3d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:44.459720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:44.462471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:44.464493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 256/501] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:44.471231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:44.473224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:44.475368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:44.475368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:44.475368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:44.475368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:44.475368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:44.475368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:44.475368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:44.475368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:44.476487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de8e5-bd34-44ef-bbac-98c5a23d3d9c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:44.476638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 246/502] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:44.476638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:44.569720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:44.646152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de8e5-bd34-44ef-bbac-98c5a23d3d9c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:44.666853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2e6d7-7a87-478f-a1ba-ecc43412d0f7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:44.682138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:44.683112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fd01a-fb28-4ff1-8e38-1bd5d1f2f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:44.683731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd01a-fb28-4ff1-8e38-1bd5d1f2f697 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.684007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd01a-fb28-4ff1-8e38-1bd5d1f2f697 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.684941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd01a-fb28-4ff1-8e38-1bd5d1f2f697 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.684941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fd01a-fb28-4ff1-8e38-1bd5d1f2f697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:44.685279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fd01a-fb28-4ff1-8e38-1bd5d1f2f697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:44.686792 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fd01a-fb28-4ff1-8e38-1bd5d1f2f697 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:44.697642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 257/503] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:44.698925 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73614-87e9-4c23-ae41-6f9f76776a26 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.699216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73614-87e9-4c23-ae41-6f9f76776a26 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.699495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73614-87e9-4c23-ae41-6f9f76776a26 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.705171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 258/504] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:44.706128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73614-87e9-4c23-ae41-6f9f76776a26 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:44.709494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04176b-2586-4d03-b5a7-7eac8b0c5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:44.710165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04176b-2586-4d03-b5a7-7eac8b0c5990 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.710599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04176b-2586-4d03-b5a7-7eac8b0c5990 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.710934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04176b-2586-4d03-b5a7-7eac8b0c5990 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.711732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04176b-2586-4d03-b5a7-7eac8b0c5990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:44.712099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04176b-2586-4d03-b5a7-7eac8b0c5990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:44.713640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04176b-2586-4d03-b5a7-7eac8b0c5990 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:44.726646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 247/505] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:44.728122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2de67-e7a3-47af-9e9f-db2f7b6f0bbe None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.728498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2de67-e7a3-47af-9e9f-db2f7b6f0bbe None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.728887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2de67-e7a3-47af-9e9f-db2f7b6f0bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.747906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d9a2de67-e7a3-47af-9e9f-db2f7b6f0bbe None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:44.749263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d9a2de67-e7a3-47af-9e9f-db2f7b6f0bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:44.819821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73614-87e9-4c23-ae41-6f9f76776a26 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:44.820049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 248/506] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:44.820967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2de67-e7a3-47af-9e9f-db2f7b6f0bbe None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:44.837574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:44.903144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:44.903901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.904188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.904466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.923971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2de67-e7a3-47af-9e9f-db2f7b6f0bbe None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:44.926953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:44.928437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:44.929909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:44.956542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:44.958634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:44.961045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:44.961045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:44.961045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:44.961045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 259/507] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:44.963357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:44.965496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:44.966099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:44.966374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:44.966668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:44.967388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] RBAC: Adding query filter params (role.id=69a9c12b055c4403bb98c1079613718c, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=7ee9a6828d334114bb3a7ae391960bf0) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:44.967689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:44.969454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:44.976057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 249/508] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:44 2022] GET /identity/v3/role_assignments?user.id=7ee9a6828d334114bb3a7ae391960bf0&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=69a9c12b055c4403bb98c1079613718c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:45.145913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa26af-9d0f-4ad3-bac3-b91c500e17dd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:45.180970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:45.181527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.181808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.182083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.182789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:45.183096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:45.184529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:45.199274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 260/509] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:45.205030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:45.227006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:45.248656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:45.337293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26590e94-145b-4ebe-8849-3ab30fa3e9d9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:45.349971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaeeba-2e67-4f6f-a164-5e364a4a98aa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:45.379562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a39160-0157-451e-b2ad-19d10e43f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:45.380214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39160-0157-451e-b2ad-19d10e43f6ec None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.380490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39160-0157-451e-b2ad-19d10e43f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.380758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39160-0157-451e-b2ad-19d10e43f6ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.388625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a39160-0157-451e-b2ad-19d10e43f6ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:45.390587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a39160-0157-451e-b2ad-19d10e43f6ec None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:45.392495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605250-d471-4c4e-9526-4d063e3591f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:45.393994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605250-d471-4c4e-9526-4d063e3591f9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.394482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605250-d471-4c4e-9526-4d063e3591f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.395161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605250-d471-4c4e-9526-4d063e3591f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d9a39160-0157-451e-b2ad-19d10e43f6ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:45.402893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:45.403870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:45.404816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 250/510] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Oct 10 16:46:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:45.405504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f62b-ae51-464a-8db2-6f0d5bdb3fcb None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.405504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f62b-ae51-464a-8db2-6f0d5bdb3fcb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.406668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f62b-ae51-464a-8db2-6f0d5bdb3fcb None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.410703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605250-d471-4c4e-9526-4d063e3591f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:45.412670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 251/511] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:45.413036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605250-d471-4c4e-9526-4d063e3591f9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:45.413515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f62b-ae51-464a-8db2-6f0d5bdb3fcb None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-18605250-d471-4c4e-9526-4d063e3591f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:45.430871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:45.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:45.432810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:45.432810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:45.432810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:45.434971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 261/512] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:45.441379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1114-29a2-4db8-b3da-bdb7cb7e441c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.442115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1114-29a2-4db8-b3da-bdb7cb7e441c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.443047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1114-29a2-4db8-b3da-bdb7cb7e441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.445175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:45.466064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-21fb1114-29a2-4db8-b3da-bdb7cb7e441c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:45.469110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-21fb1114-29a2-4db8-b3da-bdb7cb7e441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:45.529964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f62b-ae51-464a-8db2-6f0d5bdb3fcb None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:45.553426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:45.562992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 262/513] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:45.564082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb1114-29a2-4db8-b3da-bdb7cb7e441c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:45.573549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:45.574182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.574461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.574751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.575486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:45.575790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:45.578706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:45.612988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 252/514] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Oct 10 16:46:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:45.619972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:45.693149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb1114-29a2-4db8-b3da-bdb7cb7e441c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:45.733570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:45.734336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.734653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.734924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.735575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:45.735872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:45.737236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:45.754819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 263/515] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:45.757092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:45.841268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:45.845982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:45.865732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586e6e7-b325-40b4-b8d8-555ac4e3a647 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:45.932321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf1fa6-eb35-4624-92ef-ac29468a4cfd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:45.937286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e925561-c015-48a6-909f-05432862656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:45.938757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e925561-c015-48a6-909f-05432862656a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.939203 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e925561-c015-48a6-909f-05432862656a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.939643 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e925561-c015-48a6-909f-05432862656a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.951080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e925561-c015-48a6-909f-05432862656a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:45.953447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e925561-c015-48a6-909f-05432862656a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-2e925561-c015-48a6-909f-05432862656a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:45.970116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:45.971117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:45.972032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:45.972032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:45.972032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:45.972032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 253/516] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:45.972782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f8225-ecea-4980-b87d-9fa189b4d5da None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.972782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f8225-ecea-4980-b87d-9fa189b4d5da None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.972938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f8225-ecea-4980-b87d-9fa189b4d5da None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.978350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 254/517] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:45.978350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f8225-ecea-4980-b87d-9fa189b4d5da None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:45.981235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ffdd3-c3fb-4164-a792-27eadce2f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:45.981851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ffdd3-c3fb-4164-a792-27eadce2f88c None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:45.982130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ffdd3-c3fb-4164-a792-27eadce2f88c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:45.982404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ffdd3-c3fb-4164-a792-27eadce2f88c None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:45.983114 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ffdd3-c3fb-4164-a792-27eadce2f88c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:45.985074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ffdd3-c3fb-4164-a792-27eadce2f88c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:46.014697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 264/518] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:46:45 2022] POST /identity/v3/users => generated 254 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:46:46.016286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ffdd3-c3fb-4164-a792-27eadce2f88c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:46.165665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ffdd3-c3fb-4164-a792-27eadce2f88c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:46.178089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f8225-ecea-4980-b87d-9fa189b4d5da None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:46.185184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:46.217126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaed6d-bc0a-41a4-8194-3291a99f27ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:46.218699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaed6d-bc0a-41a4-8194-3291a99f27ab None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:46.219183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaed6d-bc0a-41a4-8194-3291a99f27ab None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:46.219702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaed6d-bc0a-41a4-8194-3291a99f27ab None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:46.221519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaed6d-bc0a-41a4-8194-3291a99f27ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:46.222048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaed6d-bc0a-41a4-8194-3291a99f27ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:46.223639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaed6d-bc0a-41a4-8194-3291a99f27ab None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:46.239212 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 265/519] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:46.240789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77e9e-5a48-47de-a48f-34551b3b192e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:46.241275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77e9e-5a48-47de-a48f-34551b3b192e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:46.241796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77e9e-5a48-47de-a48f-34551b3b192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:46.255389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:46.256027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:46.256303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:46.256574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:46.257153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:46.258508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:46.266154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:46.272232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-baf77e9e-5a48-47de-a48f-34551b3b192e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:46.274067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-baf77e9e-5a48-47de-a48f-34551b3b192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:46.281692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:46.282744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:46.289275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 255/520] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:45 2022] GET /identity/v3/services/network => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:46.290101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:46.359873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 266/521] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:46.360733 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf77e9e-5a48-47de-a48f-34551b3b192e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:46.424008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b3fe-0b37-48b9-b0aa-b99afebb8dc7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:46.472400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:46.474416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:46.474775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:46.475052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:46.491705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:46.494319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf77e9e-5a48-47de-a48f-34551b3b192e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:46.495421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:46.513245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:46.522848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:46.523771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:46.524664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:46.524664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:46.524664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:46.524664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:46.524664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:46.524664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:46.524664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:46.524664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:46.531752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 256/522] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:46.540173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:46.572748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:46.573590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:46.574863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:46.575160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:46.575829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] RBAC: Adding query filter params (name=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:46.576142 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:46.577809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:46.586387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 267/523] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:46:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:46.591851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:46.621045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:46.673439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0666917-711d-42b8-9ec8-37f23da5e88f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:46.725999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:46.726621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:46.727300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:46.727575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:46.728551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:46.728854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:46.731060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:46.746612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 257/524] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:46.747431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:46.757709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d567421-043a-4284-be60-31f6802ce384 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:46.803531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:46.804143 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:46.804421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:46.804690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:46.805321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] RBAC: Adding query filter params (type=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:46.805622 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:46.807131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:46.822790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 268/525] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:46:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:46.822790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:46.910204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:46.934641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb23e-f243-4b4f-a191-905be4554191 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:46.978940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:47.010413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:47.011088 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:47.011368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:47.011644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:47.012234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:47.013646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:47.033958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:47.035097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:47.035899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:47.037176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 258/526] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Oct 10 16:46:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:47.043677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:47.055566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ed79-9343-47f7-a046-f0817926bf5e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:47.104663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832769f-dc7d-4d1e-a2f8-11941f911295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:47.105520 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832769f-dc7d-4d1e-a2f8-11941f911295 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:47.105631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832769f-dc7d-4d1e-a2f8-11941f911295 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:47.105871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832769f-dc7d-4d1e-a2f8-11941f911295 None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/78b5bbfc207243febee44e0d7cacb7b7/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:47.107898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832769f-dc7d-4d1e-a2f8-11941f911295 None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=78b5bbfc207243febee44e0d7cacb7b7, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:47.109960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832769f-dc7d-4d1e-a2f8-11941f911295 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:47.136789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 269/527] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:46 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/78b5bbfc207243febee44e0d7cacb7b7/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:47.180417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e4c10-d15d-4a90-91b1-1272554cc69c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:47.220189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa08b8-9e59-4dd8-a26f-48d0a0becdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:47.220819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa08b8-9e59-4dd8-a26f-48d0a0becdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:47.221102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa08b8-9e59-4dd8-a26f-48d0a0becdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:47.221426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa08b8-9e59-4dd8-a26f-48d0a0becdf8 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:47.222081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa08b8-9e59-4dd8-a26f-48d0a0becdf8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:47.222390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa08b8-9e59-4dd8-a26f-48d0a0becdf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:47.223803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa08b8-9e59-4dd8-a26f-48d0a0becdf8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:47.234052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 259/528] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Oct 10 16:46:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:47.236669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832769f-dc7d-4d1e-a2f8-11941f911295 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:47.343933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:47.350982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832769f-dc7d-4d1e-a2f8-11941f911295 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:47.389225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c050f-bb5b-4a53-a7fd-6abb3cfe1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:47.390513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c050f-bb5b-4a53-a7fd-6abb3cfe1458 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:47.390869 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c050f-bb5b-4a53-a7fd-6abb3cfe1458 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:47.391084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c050f-bb5b-4a53-a7fd-6abb3cfe1458 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:47.391745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c050f-bb5b-4a53-a7fd-6abb3cfe1458 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:47.392050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c050f-bb5b-4a53-a7fd-6abb3cfe1458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:47.393445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c050f-bb5b-4a53-a7fd-6abb3cfe1458 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:47.402682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 270/529] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Oct 10 16:46:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:47.632626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d045be7-a2e4-4af2-8277-6ead314f5628 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:47.632925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d045be7-a2e4-4af2-8277-6ead314f5628 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:47.633128 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d045be7-a2e4-4af2-8277-6ead314f5628 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:47.634787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 260/530] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:47.640729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d0491-0d94-40af-9199-db1128d3eda3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:47.641122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d0491-0d94-40af-9199-db1128d3eda3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:47.641502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d0491-0d94-40af-9199-db1128d3eda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:47.662847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9f5d0491-0d94-40af-9199-db1128d3eda3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:47.664056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9f5d0491-0d94-40af-9199-db1128d3eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:47.738725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 271/531] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 16:46:48.110325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d045be7-a2e4-4af2-8277-6ead314f5628 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:48.165867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:48.222481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d045be7-a2e4-4af2-8277-6ead314f5628 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:48.258194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bb812-e1e5-488a-a745-11c1ed5c1864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:48.258855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb812-e1e5-488a-a745-11c1ed5c1864 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:48.259135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb812-e1e5-488a-a745-11c1ed5c1864 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:48.259410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bb812-e1e5-488a-a745-11c1ed5c1864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:48.270727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bb812-e1e5-488a-a745-11c1ed5c1864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ff2bb812-e1e5-488a-a745-11c1ed5c1864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:48.276103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:48.278148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:48.280116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:48.286593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 261/532] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:48.287861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d0491-0d94-40af-9199-db1128d3eda3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:48.394469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:48.407665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d0491-0d94-40af-9199-db1128d3eda3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:48.445878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:48.446419 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:48.446728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:48.447003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:48.447683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:48.448057 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:48.449431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:48.464038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 272/533] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:48.465377 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bb812-e1e5-488a-a745-11c1ed5c1864 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:48.574361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bb812-e1e5-488a-a745-11c1ed5c1864 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:48.591036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:48.614536 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885f739-7047-406a-afee-be70ec15561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:48.615188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f739-7047-406a-afee-be70ec15561c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:48.615470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f739-7047-406a-afee-be70ec15561c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:48.615749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f739-7047-406a-afee-be70ec15561c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:48.628410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885f739-7047-406a-afee-be70ec15561c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:48.629871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885f739-7047-406a-afee-be70ec15561c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-9885f739-7047-406a-afee-be70ec15561c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:48.645729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:48.647988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:48.650056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:48.650056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:48.650056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:48.652087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 262/534] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:48.653091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:48.725088 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661494c-3540-4009-876c-bd635f82cc70 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:48.725381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661494c-3540-4009-876c-bd635f82cc70 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:48.725550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661494c-3540-4009-876c-bd635f82cc70 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:48.728265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 263/535] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:48.733047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5080-15e0-41bd-8bb9-7d5cf2293bfe None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:48.733047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5080-15e0-41bd-8bb9-7d5cf2293bfe None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:48.734012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5080-15e0-41bd-8bb9-7d5cf2293bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:48.755223 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-814a5080-15e0-41bd-8bb9-7d5cf2293bfe None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:48.756567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-814a5080-15e0-41bd-8bb9-7d5cf2293bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:48.813563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5553aee-667f-4544-8402-5321d21b168b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:48.837030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 264/536] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:48.912647 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:48.913271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:48.913555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:48.913826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:48.914479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:48.914805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:48.916176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:48.938208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 273/537] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:48.943725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5080-15e0-41bd-8bb9-7d5cf2293bfe None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:49.084359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:49.094296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5080-15e0-41bd-8bb9-7d5cf2293bfe None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:49.131553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:49.132354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.132521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.132793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.140886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:49.142409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:49.144117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:49.157322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:49.158284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 16:46:49.159242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:49.159757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:49.162659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 265/538] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:49.164862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:49.275888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2891-d674-43b8-bca6-89c8766f3cce None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:49.313026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:49.314116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.314399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.314836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.315729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:49.316040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:49.317477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:49.342265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 266/539] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Oct 10 16:46:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:49.344353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:49.426921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:49.437496 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402a9c3-183b-4655-aff0-b4cbd9b54116 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:49.471322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3408f-75f2-4161-a98f-20f1365383d4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:49.511730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d400c-b5a6-4d63-a43a-df343907a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:49.512374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d400c-b5a6-4d63-a43a-df343907a89c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.512656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d400c-b5a6-4d63-a43a-df343907a89c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.512937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d400c-b5a6-4d63-a43a-df343907a89c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.530896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d400c-b5a6-4d63-a43a-df343907a89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5d7d400c-b5a6-4d63-a43a-df343907a89c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:49.535966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:49.538144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:49.540117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 274/540] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:49.546650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:49.546650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.546650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.546650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.547909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d400c-b5a6-4d63-a43a-df343907a89c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:49.557046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:49.558635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:49.591379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:49.593647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:49.595839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:49.595839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:49.595839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:49.595839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 267/541] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:49.604664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:49.649379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:49.676383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d400c-b5a6-4d63-a43a-df343907a89c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:49.697309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:49.713442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcb5d1-1c77-4ce3-8d2e-87a00b15e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:49.714149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb5d1-1c77-4ce3-8d2e-87a00b15e504 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.714503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb5d1-1c77-4ce3-8d2e-87a00b15e504 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.714883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb5d1-1c77-4ce3-8d2e-87a00b15e504 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.715624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb5d1-1c77-4ce3-8d2e-87a00b15e504 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:49.716001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb5d1-1c77-4ce3-8d2e-87a00b15e504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:49.717440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb5d1-1c77-4ce3-8d2e-87a00b15e504 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:49.726572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 275/542] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:49.728035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21748ed-f130-4451-95eb-832d0ebf6c58 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.728401 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21748ed-f130-4451-95eb-832d0ebf6c58 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.728751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21748ed-f130-4451-95eb-832d0ebf6c58 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.730311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 276/543] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:49.736825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21748ed-f130-4451-95eb-832d0ebf6c58 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:49.749677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187e82-461e-4668-9ab2-845ce9f35c49 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:49.787657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69533914-77c5-4857-a4a4-32a635e21d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:49.788283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533914-77c5-4857-a4a4-32a635e21d0a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.788540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533914-77c5-4857-a4a4-32a635e21d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.788808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533914-77c5-4857-a4a4-32a635e21d0a None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.789443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69533914-77c5-4857-a4a4-32a635e21d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:49.789742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69533914-77c5-4857-a4a4-32a635e21d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:49.791157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69533914-77c5-4857-a4a4-32a635e21d0a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:49.804358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 268/544] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:49.805583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c361d5-1f99-415c-a08f-d5d296e9d1d7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.805863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c361d5-1f99-415c-a08f-d5d296e9d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.806131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c361d5-1f99-415c-a08f-d5d296e9d1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.825244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-31c361d5-1f99-415c-a08f-d5d296e9d1d7 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:49.826539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-31c361d5-1f99-415c-a08f-d5d296e9d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:49.875234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21748ed-f130-4451-95eb-832d0ebf6c58 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:49.915487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 269/545] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:49.915487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c361d5-1f99-415c-a08f-d5d296e9d1d7 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:49.939581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:49.945663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17fd0c-e4e4-49e4-aa0f-ff3969bb0c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:49.946436 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fd0c-e4e4-49e4-aa0f-ff3969bb0c1f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.946717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fd0c-e4e4-49e4-aa0f-ff3969bb0c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.946990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fd0c-e4e4-49e4-aa0f-ff3969bb0c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.959217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17fd0c-e4e4-49e4-aa0f-ff3969bb0c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:49.960653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17fd0c-e4e4-49e4-aa0f-ff3969bb0c1f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:49.974969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3d17fd0c-e4e4-49e4-aa0f-ff3969bb0c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:49.977389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:49.978325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:49.979605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:49.979605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:49.979605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:49.979605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 277/546] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:49.980429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adb3d-9eb7-45ce-9e23-5e20687051f0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:49.980721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adb3d-9eb7-45ce-9e23-5e20687051f0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:49.980995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353adb3d-9eb7-45ce-9e23-5e20687051f0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:49.987194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 278/547] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:49.988012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353adb3d-9eb7-45ce-9e23-5e20687051f0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.036329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c361d5-1f99-415c-a08f-d5d296e9d1d7 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:50.072063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37c32b-83c3-437d-8ec0-c151dcca40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:50.073074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c32b-83c3-437d-8ec0-c151dcca40b8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.073608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c32b-83c3-437d-8ec0-c151dcca40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.074190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c32b-83c3-437d-8ec0-c151dcca40b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.081652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37c32b-83c3-437d-8ec0-c151dcca40b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:50.083426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37c32b-83c3-437d-8ec0-c151dcca40b8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-bd37c32b-83c3-437d-8ec0-c151dcca40b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:50.095884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:50.096799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:50.097689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:50.097689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:50.097689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:50.097689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:50.097689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:50.097689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:50.097689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:50.097689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:50.100050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 270/548] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:50.101492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52e92-1c8a-4b11-a2d3-2f9da1dda661 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.101981 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52e92-1c8a-4b11-a2d3-2f9da1dda661 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.102458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a52e92-1c8a-4b11-a2d3-2f9da1dda661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.111181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353adb3d-9eb7-45ce-9e23-5e20687051f0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:50.121984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e9a52e92-1c8a-4b11-a2d3-2f9da1dda661 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:50.123484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e9a52e92-1c8a-4b11-a2d3-2f9da1dda661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:50.153008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:50.153649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.154193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.154481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.155178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:50.156008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:50.158386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:50.176403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 279/549] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:50.177280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.203789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 271/550] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:50.205503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a52e92-1c8a-4b11-a2d3-2f9da1dda661 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.249339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:50.253217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:50.303193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c84a0-dfd1-40a3-a8c8-e2e4db9b56bd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:50.315040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a52e92-1c8a-4b11-a2d3-2f9da1dda661 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:50.340009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:50.340720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.341002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.341376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.342073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:50.342400 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:50.344916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:50.349707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b7711-767d-4200-9832-df03a8f5065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:50.350325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b7711-767d-4200-9832-df03a8f5065f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.350625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b7711-767d-4200-9832-df03a8f5065f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.350896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b7711-767d-4200-9832-df03a8f5065f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.357722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b7711-767d-4200-9832-df03a8f5065f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:50.359116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 280/551] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:50.359726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b7711-767d-4200-9832-df03a8f5065f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:50.360496 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e75b7711-767d-4200-9832-df03a8f5065f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:50.374433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:50.375707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 16:46:50.377219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:50.380364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 272/552] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Oct 10 16:46:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:50.381558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eca67-ab88-41b3-95bb-be085203662e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.381837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eca67-ab88-41b3-95bb-be085203662e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.382125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eca67-ab88-41b3-95bb-be085203662e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.387703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 273/553] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:50.387703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eca67-ab88-41b3-95bb-be085203662e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.481630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac068ce4-6c17-4ea4-bd50-9463fc9adc55 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:50.485213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:50.487908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:50.492266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eca67-ab88-41b3-95bb-be085203662e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:50.518763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1ab1-74d1-45c4-b023-51e460635214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:50.519364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1ab1-74d1-45c4-b023-51e460635214 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.519638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1ab1-74d1-45c4-b023-51e460635214 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.519912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1ab1-74d1-45c4-b023-51e460635214 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.520552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a1ab1-74d1-45c4-b023-51e460635214 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:50.521907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a1ab1-74d1-45c4-b023-51e460635214 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:50.526614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b996d76-453a-427a-a4f1-62dd0f66357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:50.527266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996d76-453a-427a-a4f1-62dd0f66357e None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.527629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996d76-453a-427a-a4f1-62dd0f66357e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.527818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996d76-453a-427a-a4f1-62dd0f66357e None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/7ee9a6828d334114bb3a7ae391960bf0/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.529976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b996d76-453a-427a-a4f1-62dd0f66357e None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=7ee9a6828d334114bb3a7ae391960bf0, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:50.531719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b996d76-453a-427a-a4f1-62dd0f66357e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:50.539156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 281/554] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:46:50 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:50.540284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1ab1-74d1-45c4-b023-51e460635214 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.545332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 274/555] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:50 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/7ee9a6828d334114bb3a7ae391960bf0/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:50.552922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3737c-9f63-4382-b44c-ce4741e47b26 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.553603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3737c-9f63-4382-b44c-ce4741e47b26 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.554158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3737c-9f63-4382-b44c-ce4741e47b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.580439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9ed3737c-9f63-4382-b44c-ce4741e47b26 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:50.581801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9ed3737c-9f63-4382-b44c-ce4741e47b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:50.682129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 275/556] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:50 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 16:46:50.683160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3737c-9f63-4382-b44c-ce4741e47b26 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.684808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1ab1-74d1-45c4-b023-51e460635214 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:50.758511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:50.759460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.759913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.760367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.761286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:50.761764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:50.763428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:50.782506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 282/557] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Oct 10 16:46:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:50.788440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.836518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:50.840509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:50.869726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3737c-9f63-4382-b44c-ce4741e47b26 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:50.944160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523bb2-74ad-4a9a-9ea6-c9605f20148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:50.945111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523bb2-74ad-4a9a-9ea6-c9605f20148d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:50.945604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523bb2-74ad-4a9a-9ea6-c9605f20148d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:50.946062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523bb2-74ad-4a9a-9ea6-c9605f20148d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:50.969004 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3523bb2-74ad-4a9a-9ea6-c9605f20148d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-c3523bb2-74ad-4a9a-9ea6-c9605f20148d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:50.974716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:50.975649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:50.976530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:50.978728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 276/558] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:50.979372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523bb2-74ad-4a9a-9ea6-c9605f20148d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:50.992417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ee32-3f35-45cd-bcfc-a4e7d2e842a3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:51.032119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:51.032677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:51.033005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:51.033277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:51.046536 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:51.048913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:51.066364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:51.067446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:51.068372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:51.068372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:51.068372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:51.068372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 283/559] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:51.069162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:51.129066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523bb2-74ad-4a9a-9ea6-c9605f20148d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:51.166810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:51.172368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f12b99-a4c9-487a-814b-920add8adc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:51.172983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f12b99-a4c9-487a-814b-920add8adc85 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:51.173270 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f12b99-a4c9-487a-814b-920add8adc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:51.173540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f12b99-a4c9-487a-814b-920add8adc85 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:51.174199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f12b99-a4c9-487a-814b-920add8adc85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:51.175611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f12b99-a4c9-487a-814b-920add8adc85 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:51.197940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948619-102b-400e-92ba-4135fc961657 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:51.199020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 277/560] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:46:50 2022] POST /identity/v3/services => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:51.199949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f12b99-a4c9-487a-814b-920add8adc85 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:51.220760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:51.255984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:51.257104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:51.257590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:51.258067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:51.258996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:51.259543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:51.261203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:51.284111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 284/561] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:51.290900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:51.351160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f12b99-a4c9-487a-814b-920add8adc85 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:51.390303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:51.390965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:51.391226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:51.391490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:51.392225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:51.392530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:51.393956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:51.408380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 278/562] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:51.414439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:51.493388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500368fa-1c22-4f9a-9bc1-5d02276feab0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:51.494363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:51.530783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:51.536957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:51.537527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:51.537809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:51.538084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:51.547105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1111-db0b-4a13-8fd4-9aa33bdd7f4f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:51.561941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:51.563443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:51.589454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:51.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:51.591430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:51.591430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:51.591430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:51.591430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 285/563] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:51.598168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:51.622750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:51.623406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:51.623684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:51.626082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:51.640557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:51.645189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:51.668667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:51.669615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:51.670483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 279/564] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:51.679457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:51.751958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7117e6-108c-43bb-8768-64a42c4ed355 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:51.802629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:51.803177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:51.803459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:51.803734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:51.804388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:51.804691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:51.809675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:51.834932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 286/565] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:51.840458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:51.857077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b294a6c-a729-4b87-940c-3de3a3077879 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:51.895531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:51.924311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:51.942306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:51.943356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:51.943818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:51.945165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:51.946043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:51.946814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:51.949769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:51.977442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 280/566] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:51.984092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:52.000538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba626-aa3c-49ee-a15a-cf8f09160c68 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:52.073187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:52.074142 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:52.074670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:52.075147 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:52.093298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:52.096245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:52.126995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:52.128011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:46:52.129063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:52.133566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 287/567] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Oct 10 16:46:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:52.137982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:52.176444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8965-1831-4c1c-b741-4262aff368ad None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:52.213572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129346c-5432-4e07-98ce-f8eeba4fa1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:52.214504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129346c-5432-4e07-98ce-f8eeba4fa1cd None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:52.214960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129346c-5432-4e07-98ce-f8eeba4fa1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:52.215423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129346c-5432-4e07-98ce-f8eeba4fa1cd None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/0bda53b55a944877893a20c799fb7c8e/roles/69a9c12b055c4403bb98c1079613718c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:52.232047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129346c-5432-4e07-98ce-f8eeba4fa1cd None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=0bda53b55a944877893a20c799fb7c8e, role_id=69a9c12b055c4403bb98c1079613718c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:52.235079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129346c-5432-4e07-98ce-f8eeba4fa1cd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:52.256240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 281/568] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:46:51 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/0bda53b55a944877893a20c799fb7c8e/roles/69a9c12b055c4403bb98c1079613718c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:46:52.313136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0cca0-eeef-4929-b2b6-2d8071b7e38c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:52.315673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:52.351509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:52.352036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:52.352314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:52.352587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:52.353315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:52.353616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:52.355085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:52.374455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 288/569] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Oct 10 16:46:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:52.380105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129346c-5432-4e07-98ce-f8eeba4fa1cd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:52.424832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:52.522500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129346c-5432-4e07-98ce-f8eeba4fa1cd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:52.559792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c159da-34fa-4cc4-91f4-48694a5664bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:52.560748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c159da-34fa-4cc4-91f4-48694a5664bf None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:52.561278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c159da-34fa-4cc4-91f4-48694a5664bf None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:52.562720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c159da-34fa-4cc4-91f4-48694a5664bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:52.635664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c159da-34fa-4cc4-91f4-48694a5664bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:52.637493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c159da-34fa-4cc4-91f4-48694a5664bf None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:52.674964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:52.743854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 282/570] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:46:52.749021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:52.896155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cacb1-8c23-494a-bb8e-1fe3175b6e65 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:52.935208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:52.935842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:52.936121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:52.936988 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:52.958240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:52.959875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:52.978814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:52.979846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:52.981431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:52.981431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:52.981431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:52.981431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 289/571] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:52.986113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c159da-34fa-4cc4-91f4-48694a5664bf None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:53.102070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c159da-34fa-4cc4-91f4-48694a5664bf None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:53.150162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322b9aa-946b-449b-a530-a11131fbe229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:53.151190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b9aa-946b-449b-a530-a11131fbe229 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.151680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b9aa-946b-449b-a530-a11131fbe229 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.152178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b9aa-946b-449b-a530-a11131fbe229 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.153082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b9aa-946b-449b-a530-a11131fbe229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:53.153608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b9aa-946b-449b-a530-a11131fbe229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:53.155852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b9aa-946b-449b-a530-a11131fbe229 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:53.159151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:53.174955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 283/572] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:53.179604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:53.214912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:53.248545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1242-1194-48b4-92d0-56cf470d1aec None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.250140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1242-1194-48b4-92d0-56cf470d1aec None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.250140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1242-1194-48b4-92d0-56cf470d1aec None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.251282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 284/573] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:46:53.257827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703cc3-a1a3-4db3-a7f2-38b9a83e5081 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.258112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703cc3-a1a3-4db3-a7f2-38b9a83e5081 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.258391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703cc3-a1a3-4db3-a7f2-38b9a83e5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.289031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-cb703cc3-a1a3-4db3-a7f2-38b9a83e5081 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:53.290232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cb703cc3-a1a3-4db3-a7f2-38b9a83e5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:53.337226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c35ba-da85-48af-8ca4-515e5a9611e0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:53.367752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 285/574] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:46:53.369325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca19a3d-0cf8-4dc5-a57a-8bb4c8a3330b None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.369809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca19a3d-0cf8-4dc5-a57a-8bb4c8a3330b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.370295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca19a3d-0cf8-4dc5-a57a-8bb4c8a3330b None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.371995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 286/575] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:53.377820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b722-ade4-49bd-abe3-43e8849ff8ab None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.378339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b722-ade4-49bd-abe3-43e8849ff8ab None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.378992 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b722-ade4-49bd-abe3-43e8849ff8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.403190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:53.403759 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.404043 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.404323 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.407485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6c98b722-ade4-49bd-abe3-43e8849ff8ab None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:53.408887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6c98b722-ade4-49bd-abe3-43e8849ff8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:53.419598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:53.421597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:53.444667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:53.445600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:53.446468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:53.446468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:53.446468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:53.446468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:53.446468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:53.446468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:53.446468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:53.446468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:53.450739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 290/576] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:53.455513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:53.503944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 287/577] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:46:53.568303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:53.604325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75988c-baea-400b-99bd-6e4880422a45 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:53.652338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:53.653487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.653987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.654461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.656039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:53.656551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:53.658191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:53.671313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 291/578] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:53.679628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b722-ade4-49bd-abe3-43e8849ff8ab None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:53.719538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:53.784098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:53.846029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5cbf0-ffc8-4215-b660-a5b3e9c651bc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:53.863767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b722-ade4-49bd-abe3-43e8849ff8ab None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:53.888404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:53.889042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.889316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.889659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] PATH_INFO: `/v3/services/network` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.890962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:53.892374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:53.894292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:53.906055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:53.907216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:53.908109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 292/579] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:53 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:46:53.909138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:53.914821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21691-6d51-4099-a40b-a9c209d61fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:53.915440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21691-6d51-4099-a40b-a9c209d61fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.915721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21691-6d51-4099-a40b-a9c209d61fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.915996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21691-6d51-4099-a40b-a9c209d61fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.916756 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21691-6d51-4099-a40b-a9c209d61fb4 None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=78b5bbfc207243febee44e0d7cacb7b7) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:53.917063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21691-6d51-4099-a40b-a9c209d61fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:53.918902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21691-6d51-4099-a40b-a9c209d61fb4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:53.926572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 288/580] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:53 2022] GET /identity/v3/role_assignments?user.id=78b5bbfc207243febee44e0d7cacb7b7&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:53.927499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9f5e-f53e-4d7b-b134-31933e942057 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:53.927779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9f5e-f53e-4d7b-b134-31933e942057 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:53.928100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9f5e-f53e-4d7b-b134-31933e942057 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:53.933379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 289/581] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:53.933379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd9f5e-f53e-4d7b-b134-31933e942057 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.043697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feecbb0-e196-47a0-8de2-04ad4159a69f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:54.081985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d16f3e-8efb-4483-afdf-c1132e3d2441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:54.082969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16f3e-8efb-4483-afdf-c1132e3d2441 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.083411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16f3e-8efb-4483-afdf-c1132e3d2441 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.083839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16f3e-8efb-4483-afdf-c1132e3d2441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.087620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd9f5e-f53e-4d7b-b134-31933e942057 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:54.103148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d16f3e-8efb-4483-afdf-c1132e3d2441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d3d16f3e-8efb-4483-afdf-c1132e3d2441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:54.109008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:54.110068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:54.111347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 293/582] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:54.112081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1af8dc-371a-4e52-8911-84b3ebcde063 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.112081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1af8dc-371a-4e52-8911-84b3ebcde063 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.112223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1af8dc-371a-4e52-8911-84b3ebcde063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.119430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:54.134091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0a1af8dc-371a-4e52-8911-84b3ebcde063 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:54.136148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0a1af8dc-371a-4e52-8911-84b3ebcde063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:54.144955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:54.145891 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.146454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.146827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.147540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] RBAC: Adding query filter params (name=network) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:54.147936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:54.149363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:54.154547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 290/583] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:46:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:54.155994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.208125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:54.227428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 294/584] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:46:54.229066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1af8dc-371a-4e52-8911-84b3ebcde063 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.269403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6869a3-76d8-4af9-bc97-a58d03952cda None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:54.306683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:54.307291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.307572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.307932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.308666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:54.309102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:54.310482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:54.320232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 291/585] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:46:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:54.328238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.351529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1af8dc-371a-4e52-8911-84b3ebcde063 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:54.392619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:54.393230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.393507 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.393778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.394684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] RBAC: Adding query filter params (type=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:54.394987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:54.396352 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:54.402589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 295/586] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:46:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:54.409889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.419013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:54.471005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:54.531758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb876f17-7393-4421-b394-c217912aa769 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:54.557409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8511dd-9fe7-4cf2-a870-302ae875daf7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:54.575277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:54.575898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.576176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.576447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.577701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] RBAC: Adding query filter params (interface=public, service_id=2265202d80124f84bfd72c15751c95dc, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:54.578003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:54.579482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:54.587457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 296/587] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Oct 10 16:46:54 2022] GET /identity/v3/endpoints?service_id=2265202d80124f84bfd72c15751c95dc&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:54.592464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.605969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:54.606627 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.606905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.607174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.618653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:54.620047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:54.635673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:54.636662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:54.637562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:54.637562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:54.637562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:54.642293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 292/588] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:54.643201 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.735806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f268-31b9-4763-9452-d87be4ccb62f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:54.750153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:54.754598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089d344-2814-4ed3-9c8e-cf3effd0bfdc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:54.759982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:54.786006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:54.787169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.787888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.788557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.789291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:54.791438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:54.795767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7436137-a4c4-4d1e-a3e1-3d1981e09546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:54.796587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436137-a4c4-4d1e-a3e1-3d1981e09546 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:54.796942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436137-a4c4-4d1e-a3e1-3d1981e09546 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:54.797316 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436137-a4c4-4d1e-a3e1-3d1981e09546 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:54.798031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7436137-a4c4-4d1e-a3e1-3d1981e09546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:54.799587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7436137-a4c4-4d1e-a3e1-3d1981e09546 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:54.803356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:54.804530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:54.805566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:54.807649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 297/589] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Oct 10 16:46:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:54.814558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 293/590] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:46:54 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:54.814750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.814842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7436137-a4c4-4d1e-a3e1-3d1981e09546 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:54.984287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7436137-a4c4-4d1e-a3e1-3d1981e09546 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.048116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e378dbb-683a-45f3-85f3-8e4368b5800c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.058730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074460c9-4c7e-4ab3-a6ec-bdd256d2135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.059638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074460c9-4c7e-4ab3-a6ec-bdd256d2135e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.060097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074460c9-4c7e-4ab3-a6ec-bdd256d2135e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.060568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074460c9-4c7e-4ab3-a6ec-bdd256d2135e None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.062447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074460c9-4c7e-4ab3-a6ec-bdd256d2135e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:55.062961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074460c9-4c7e-4ab3-a6ec-bdd256d2135e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:55.065295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074460c9-4c7e-4ab3-a6ec-bdd256d2135e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:55.072766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 294/591] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Oct 10 16:46:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:55.074271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2399b-2b03-414f-84eb-aa1193165102 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.074783 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2399b-2b03-414f-84eb-aa1193165102 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.075325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2399b-2b03-414f-84eb-aa1193165102 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.079114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 295/592] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:55.079114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2399b-2b03-414f-84eb-aa1193165102 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:55.094721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb392a-d986-4412-a8fc-cfdcbc0081ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.095335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb392a-d986-4412-a8fc-cfdcbc0081ef None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.095799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb392a-d986-4412-a8fc-cfdcbc0081ef None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.096142 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb392a-d986-4412-a8fc-cfdcbc0081ef None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.097184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb392a-d986-4412-a8fc-cfdcbc0081ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:55.097497 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb392a-d986-4412-a8fc-cfdcbc0081ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:55.099337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb392a-d986-4412-a8fc-cfdcbc0081ef None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:55.109751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:55.115914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 298/593] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:55.119901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6919-d4b6-43a8-a044-29057c79df44 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.120361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6919-d4b6-43a8-a044-29057c79df44 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.120639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6919-d4b6-43a8-a044-29057c79df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.148998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-71da6919-d4b6-43a8-a044-29057c79df44 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:55.150729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-71da6919-d4b6-43a8-a044-29057c79df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:55.193115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:55.211661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2399b-2b03-414f-84eb-aa1193165102 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.234355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 299/594] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:46:55.235279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6919-d4b6-43a8-a044-29057c79df44 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:55.256196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.257055 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.257726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.258006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.258672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:55.258979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:55.260902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:55.270085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 296/595] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Oct 10 16:46:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:55.275203 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:55.403728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:55.412829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c76d11-c90b-4d29-9918-59237fb9cad3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.426335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6919-d4b6-43a8-a044-29057c79df44 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.451764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.452674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.453085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.453367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.454160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] RBAC: Adding query filter params (interface=public, service_id=5374003768614ba3bf42db0c08dc9621, region_id=RegionOne) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:55.454470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:55.455855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:55.463892 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 297/596] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Oct 10 16:46:55 2022] GET /identity/v3/endpoints?service_id=5374003768614ba3bf42db0c08dc9621&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:55.475384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:55.487265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.488146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.488585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.489037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.503013 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:55.510540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:55.527003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:55.528014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:55.528989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 300/597] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:46:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:55.529692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:55.572921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:55.602316 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdf0ad-47dc-42d0-8cf9-3d8c2a8e3658 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.637747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719048-e4f7-4650-8aa6-50f326ce36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.638465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719048-e4f7-4650-8aa6-50f326ce36bc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.638841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719048-e4f7-4650-8aa6-50f326ce36bc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.639189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719048-e4f7-4650-8aa6-50f326ce36bc None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.640541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24719048-e4f7-4650-8aa6-50f326ce36bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:55.641986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24719048-e4f7-4650-8aa6-50f326ce36bc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:55.647753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 298/598] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:46:55 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:55.648807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719048-e4f7-4650-8aa6-50f326ce36bc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:55.656919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b57d6-3682-465d-9782-6df6471f6e45 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.669462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:55.698412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf787ac-d3d2-434b-99b4-b51c6a34f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.699403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf787ac-d3d2-434b-99b4-b51c6a34f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.699876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf787ac-d3d2-434b-99b4-b51c6a34f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.700318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf787ac-d3d2-434b-99b4-b51c6a34f4e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.712921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf787ac-d3d2-434b-99b4-b51c6a34f4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cbf787ac-d3d2-434b-99b4-b51c6a34f4e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:46:55.719370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:55.720603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:46:55.721629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:55.724223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 301/599] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:46:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:55.730671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf787ac-d3d2-434b-99b4-b51c6a34f4e5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:55.763059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719048-e4f7-4650-8aa6-50f326ce36bc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.801338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.802031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.802234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.802509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.803283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:55.803591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:55.805180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:55.830665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 299/600] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Oct 10 16:46:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:55.832754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:55.916113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:55.942937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:55.943130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aed78c-1377-4c2c-9203-f6ae6da417d4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.950771 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf787ac-d3d2-434b-99b4-b51c6a34f4e5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:55.980860 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78565434-c398-4636-bad7-fd96dcead0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:55.981593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78565434-c398-4636-bad7-fd96dcead0cf None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:55.981875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78565434-c398-4636-bad7-fd96dcead0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:55.982145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78565434-c398-4636-bad7-fd96dcead0cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:55.997411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:56.000597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:56.000881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:56.001224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:56.002263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:56.002593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:56.003973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:56.020833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 302/601] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:56.026387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:56.143375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78565434-c398-4636-bad7-fd96dcead0cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:56.144957 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78565434-c398-4636-bad7-fd96dcead0cf None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:56.179830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee7df4-8966-4dc9-97a1-fd9304f15c0b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:56.220299 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:56.220993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:56.221271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:56.221544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:56.233955 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:56.236239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:56.253791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:56.254832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:56.255715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:56.255715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:56.255715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:56.255715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 303/602] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:56.260332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:56.266239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:56.330558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:56.371167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 300/603] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 10 16:46:56.377581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78565434-c398-4636-bad7-fd96dcead0cf None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:56.473060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23060052-0fb4-4d3a-80de-7d367cfde83f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:56.516045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:56.516660 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:56.516938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:56.517212 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:56.518164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:56.518468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:56.519855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:56.549595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 304/604] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:56.555532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:56.582251 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78565434-c398-4636-bad7-fd96dcead0cf None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:56.620247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09574d3d-4d93-4b2f-a4f7-b732a15bc460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:56.620886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09574d3d-4d93-4b2f-a4f7-b732a15bc460 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:56.621225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09574d3d-4d93-4b2f-a4f7-b732a15bc460 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:56.621503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09574d3d-4d93-4b2f-a4f7-b732a15bc460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:56.629892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:56.632111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09574d3d-4d93-4b2f-a4f7-b732a15bc460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:56.633664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09574d3d-4d93-4b2f-a4f7-b732a15bc460 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-09574d3d-4d93-4b2f-a4f7-b732a15bc460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:56.650578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:56.651734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:56.652723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:56.652723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:56.652723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:56.652723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 301/605] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:56.652996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af6b4-13e9-4ac6-8482-a9819c4c3f8b None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:56.653339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af6b4-13e9-4ac6-8482-a9819c4c3f8b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:56.653552 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af6b4-13e9-4ac6-8482-a9819c4c3f8b None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:56.659711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 302/606] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:56.664661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9af6b4-13e9-4ac6-8482-a9819c4c3f8b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:56.676412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399709a4-bd25-496f-8f3c-eec027563dd0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:56.720160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c179-bd7a-43a3-83c5-e0d7ef7f7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:56.721074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c179-bd7a-43a3-83c5-e0d7ef7f7c81 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:56.721515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c179-bd7a-43a3-83c5-e0d7ef7f7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:56.721932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c179-bd7a-43a3-83c5-e0d7ef7f7c81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:56.735228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702c179-bd7a-43a3-83c5-e0d7ef7f7c81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:56.737176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702c179-bd7a-43a3-83c5-e0d7ef7f7c81 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-2702c179-bd7a-43a3-83c5-e0d7ef7f7c81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:46:56.753145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:56.754399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 16:46:56.755588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:56.756157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:56.763472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 305/607] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Oct 10 16:46:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:56.766335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da065ec-9d6d-439c-a368-aca110b8d8da None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:56.766816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da065ec-9d6d-439c-a368-aca110b8d8da None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:56.767234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da065ec-9d6d-439c-a368-aca110b8d8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:56.783414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9af6b4-13e9-4ac6-8482-a9819c4c3f8b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:56.789340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5da065ec-9d6d-439c-a368-aca110b8d8da None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:56.790704 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5da065ec-9d6d-439c-a368-aca110b8d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:56.821590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:56.822116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:56.822397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:56.822700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:56.823340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:56.823641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:56.825056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:56.838644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 303/608] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:56.839691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:56.867884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 306/609] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:46:56.869148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da065ec-9d6d-439c-a368-aca110b8d8da None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:56.929833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:56.987895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:57.004842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da065ec-9d6d-439c-a368-aca110b8d8da None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:57.018420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9491b-50c4-4c3e-a6c2-d8f1754341c4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:57.077602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:57.078193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.078474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.078775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.083676 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:57.084286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.084564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.084835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.085566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:57.085867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:57.087391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:57.092508 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:57.094187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:57.107218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:57.108195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:57.109424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:57.109424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:57.109424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:57.109424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:57.109424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:57.109424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:57.109424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:57.109424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:57.111709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 307/610] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:57.119049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 304/611] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Oct 10 16:46:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:57.123533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:57.129454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:57.245473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91528f9b-15c6-4e63-ac81-493177e003b1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:57.277239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:57.291578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:57.292403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.292848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.293092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364cc26-6c7f-4a0b-9ac5-9b9c3e851632 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:57.293443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.294286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:57.294907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:57.297598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:57.313277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 308/612] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:57.314381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:57.331973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72e880-1cb8-4e8d-a644-b4ed14b7716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:57.332750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72e880-1cb8-4e8d-a644-b4ed14b7716f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.333119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72e880-1cb8-4e8d-a644-b4ed14b7716f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.333549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72e880-1cb8-4e8d-a644-b4ed14b7716f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.351885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:57.409220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72e880-1cb8-4e8d-a644-b4ed14b7716f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:57.410933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72e880-1cb8-4e8d-a644-b4ed14b7716f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:57.430454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c95e9-edda-4da8-ac41-d21623f0dd5e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:57.468531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:57.469162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.469445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.469716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.470294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:57.471681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:57.481811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:57.482777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:57.483811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 309/613] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Oct 10 16:46:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:57.484599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:57.515900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 305/614] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:46:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:46:57.517361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782c8a-e230-4289-89e0-9f023082b17d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.517640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782c8a-e230-4289-89e0-9f023082b17d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.517910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782c8a-e230-4289-89e0-9f023082b17d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.519306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 306/615] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:57.519844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc782c8a-e230-4289-89e0-9f023082b17d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:57.535257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:57.572873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:57.598604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3842736-e4b4-40c2-a3bc-9deb6ee2031f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:57.633975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc782c8a-e230-4289-89e0-9f023082b17d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:57.636929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:57.637540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.637822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.638096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.638852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=7ee9a6828d334114bb3a7ae391960bf0) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:57.639157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:57.641365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:57.647633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 310/616] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:57 2022] GET /identity/v3/role_assignments?user.id=7ee9a6828d334114bb3a7ae391960bf0&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:57.648427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:57.687733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f1b3-da47-4ce2-af67-7e4668c0b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:57.688362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f1b3-da47-4ce2-af67-7e4668c0b99d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.688640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f1b3-da47-4ce2-af67-7e4668c0b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.688914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f1b3-da47-4ce2-af67-7e4668c0b99d None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.689563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f1b3-da47-4ce2-af67-7e4668c0b99d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:57.689865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f1b3-da47-4ce2-af67-7e4668c0b99d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:57.691314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f1b3-da47-4ce2-af67-7e4668c0b99d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:57.701057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 307/617] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:46:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:57.702586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16ca9-27ce-422d-bd6c-48b26f96b34c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.702879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16ca9-27ce-422d-bd6c-48b26f96b34c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.703156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16ca9-27ce-422d-bd6c-48b26f96b34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.723668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9da16ca9-27ce-422d-bd6c-48b26f96b34c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:57.724882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9da16ca9-27ce-422d-bd6c-48b26f96b34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:57.782720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897762-92bd-475a-997d-5e54403dc91a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:57.785470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:57.815986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 308/618] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:46:57.822754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da16ca9-27ce-422d-bd6c-48b26f96b34c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:57.827871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:57.828812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:57.829291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:57.829735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:57.845003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:57.847760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:46:57.868480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:57.869502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:46:57.870430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:46:57.870430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:46:57.870430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:57.872566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 311/619] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:57.878927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:57.903198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:57.985695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da16ca9-27ce-422d-bd6c-48b26f96b34c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.041155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0c6bd-b541-420e-81ec-a1f7465a3656 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.055218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.055881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.056161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.056431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.057708 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:58.058017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.059426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.070114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 309/620] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:46:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:58.099078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80f0c1-dca8-4178-9d15-30bbeb8ad927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.099697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f0c1-dca8-4178-9d15-30bbeb8ad927 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.100064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f0c1-dca8-4178-9d15-30bbeb8ad927 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.100349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80f0c1-dca8-4178-9d15-30bbeb8ad927 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.101006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80f0c1-dca8-4178-9d15-30bbeb8ad927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:58.101311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80f0c1-dca8-4178-9d15-30bbeb8ad927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.102716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80f0c1-dca8-4178-9d15-30bbeb8ad927 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.120759 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 312/621] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:58.126228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:58.141856 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a7a2-41fc-4bd7-a5c1-9d1a34b649ab None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.142194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a7a2-41fc-4bd7-a5c1-9d1a34b649ab None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.142406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a7a2-41fc-4bd7-a5c1-9d1a34b649ab None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.143852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 313/622] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:46:58.149516 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a7a2-41fc-4bd7-a5c1-9d1a34b649ab None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:58.167627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:58.262173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034211a-0a51-42d2-a763-0adc346ffbe6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.266049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:58.277047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a7a2-41fc-4bd7-a5c1-9d1a34b649ab None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.306740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d616e7-9450-4d55-a967-8a5bd30ef9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.307306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d616e7-9450-4d55-a967-8a5bd30ef9dd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.307587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d616e7-9450-4d55-a967-8a5bd30ef9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.308106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d616e7-9450-4d55-a967-8a5bd30ef9dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.317436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d616e7-9450-4d55-a967-8a5bd30ef9dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.319158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d616e7-9450-4d55-a967-8a5bd30ef9dd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.322093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.322833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.323119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.323392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] PATH_INFO: `/v3/services/network` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.323985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.325340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-56d616e7-9450-4d55-a967-8a5bd30ef9dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:46:58.335589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:58.336808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:58.337711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:46:58.337711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:46:58.337711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:46:58.337711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:46:58.337711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:46:58.337711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:46:58.337711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:46:58.337711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:58.338144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:58.340000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 16:46:58.341958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:58.345076 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 310/623] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:58.345076 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595ed8-4fcd-4c10-80b1-17bd68a0a266 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.345076 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595ed8-4fcd-4c10-80b1-17bd68a0a266 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.345577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 314/624] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:46:58 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:58.345724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595ed8-4fcd-4c10-80b1-17bd68a0a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.345866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:58.371046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9c595ed8-4fcd-4c10-80b1-17bd68a0a266 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:46:58.372241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9c595ed8-4fcd-4c10-80b1-17bd68a0a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:46:58.445126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:58.465602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 311/625] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:46:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:46:58.467069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c595ed8-4fcd-4c10-80b1-17bd68a0a266 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:58.471193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95833d4-73a0-454b-b5b2-56fc85f6296d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.513105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.513721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.514117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.514950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.515589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] RBAC: Adding query filter params (name=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:58.515889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.517267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.526837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 315/626] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:46:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:58.528530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:58.640508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:58.654609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c595ed8-4fcd-4c10-80b1-17bd68a0a266 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.730775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.731392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.731671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.731944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.732640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:58.732969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.734938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.745014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30bc47-9385-4faa-a965-3c4a55091447 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.765485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 312/627] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:58.771212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:58.790151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.790799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.791078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.791411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.792112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:58.792413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.797935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.802262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 316/628] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:46:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:58.803285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:58.814746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:58.917932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2afb9-4bc5-4159-b915-ff81880a4ae8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.923969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923149e8-e4c0-47d9-bddb-b31009e6e4a4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:58.957280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.958462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.959001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.959555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.960495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] RBAC: Adding query filter params (role.id=69a9c12b055c4403bb98c1079613718c, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=0bda53b55a944877893a20c799fb7c8e) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:58.961063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.962805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.967110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:58.968397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:58.968669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:58.968935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:58.969523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:58.970896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:58.980924 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 313/629] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:46:58 2022] GET /identity/v3/role_assignments?user.id=0bda53b55a944877893a20c799fb7c8e&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=69a9c12b055c4403bb98c1079613718c => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:46:58.981060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:46:58.982263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 16:46:58.983667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:46:58.985696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:58.987940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 317/630] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Oct 10 16:46:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:46:58.988920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:59.014810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:59.080841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:59.117079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de19ba-0916-4916-bca5-ba2c51dde01c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:59.158774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:59.159575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:59.159857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:59.160131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:59.160951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:59.161281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:59.162796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:59.168432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 318/631] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Oct 10 16:46:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:46:59.174677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:59.210656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb982-d3ed-4c48-8bf7-a98fb9635e98 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:59.250190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d946d55-dd23-4748-b44a-bbf48209771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:59.250841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946d55-dd23-4748-b44a-bbf48209771f None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:59.251117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946d55-dd23-4748-b44a-bbf48209771f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:59.251388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946d55-dd23-4748-b44a-bbf48209771f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:59.252325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d946d55-dd23-4748-b44a-bbf48209771f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:59.253688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d946d55-dd23-4748-b44a-bbf48209771f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:59.283994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 314/632] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:46:58 2022] POST /identity/v3/endpoints => generated 337 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:46:59.292530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b40d57-3891-4278-9ddb-7a4da728d2be None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:59.335895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:59.342257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481a561-8f41-47a6-8dbf-47aebb74e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:59.343505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a561-8f41-47a6-8dbf-47aebb74e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:59.344444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a561-8f41-47a6-8dbf-47aebb74e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:59.345217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a561-8f41-47a6-8dbf-47aebb74e2d2 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:59.346298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481a561-8f41-47a6-8dbf-47aebb74e2d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:46:59.346633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481a561-8f41-47a6-8dbf-47aebb74e2d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:59.348065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481a561-8f41-47a6-8dbf-47aebb74e2d2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:59.354338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 319/633] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Oct 10 16:46:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:46:59.360825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d946d55-dd23-4748-b44a-bbf48209771f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:46:59.455883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:46:59.490093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d946d55-dd23-4748-b44a-bbf48209771f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:46:59.526549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3610-b454-4b57-a927-c21950e77a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:46:59.527177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3610-b454-4b57-a927-c21950e77a96 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:46:59.527454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3610-b454-4b57-a927-c21950e77a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:46:59.527726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3610-b454-4b57-a927-c21950e77a96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:46:59.528415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3610-b454-4b57-a927-c21950e77a96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:46:59.530049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3610-b454-4b57-a927-c21950e77a96 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:46:59.556529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 315/634] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:46:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:00.145009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c6b0-4dfe-42bc-a2b9-f859c56ef5b4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:00.145373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c6b0-4dfe-42bc-a2b9-f859c56ef5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:00.145549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c6b0-4dfe-42bc-a2b9-f859c56ef5b4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:00.147141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 320/635] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:00.152488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1f1b-c9ae-4944-80bb-78901c544472 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:00.153018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1f1b-c9ae-4944-80bb-78901c544472 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:00.153494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e1f1b-c9ae-4944-80bb-78901c544472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:00.172822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0b4e1f1b-c9ae-4944-80bb-78901c544472 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:00.174330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0b4e1f1b-c9ae-4944-80bb-78901c544472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:00.258662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 316/636] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:00.532233 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c6b0-4dfe-42bc-a2b9-f859c56ef5b4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:00.591150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e958b6f-186a-477c-9780-db9e88a8310e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:00.591701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e958b6f-186a-477c-9780-db9e88a8310e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:00.591701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e958b6f-186a-477c-9780-db9e88a8310e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:00.594487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 317/637] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:47:00.599401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6730c-a830-4ade-9de7-660f02aef46f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:00.599694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6730c-a830-4ade-9de7-660f02aef46f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:00.599946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6730c-a830-4ade-9de7-660f02aef46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:00.619551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-93a6730c-a830-4ade-9de7-660f02aef46f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:00.620832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-93a6730c-a830-4ade-9de7-660f02aef46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:00.650729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c6b0-4dfe-42bc-a2b9-f859c56ef5b4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:00.675510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:00.692744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:00.693604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:00.694026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:00.694441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:00.695190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:00.696844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:00.698594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 318/638] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:00.711480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:00.712633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:00.713479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:00.715617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 321/639] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:00.722132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6730c-a830-4ade-9de7-660f02aef46f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:00.824673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6730c-a830-4ade-9de7-660f02aef46f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:00.860412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:00.861239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:00.861661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:00.862104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:00.862985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:00.863592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:00.865110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:00.870095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 319/640] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:00.876174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:00.947924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:00.983748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:00.985671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28ae1-17f9-4c2f-8705-6b817a6563e6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:01.024657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b42f38-7739-42ff-b5e9-aea190404437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:01.025608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b42f38-7739-42ff-b5e9-aea190404437 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:01.026064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b42f38-7739-42ff-b5e9-aea190404437 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:01.026538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b42f38-7739-42ff-b5e9-aea190404437 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:01.027362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b42f38-7739-42ff-b5e9-aea190404437 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:01.027840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b42f38-7739-42ff-b5e9-aea190404437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:01.029385 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b42f38-7739-42ff-b5e9-aea190404437 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:01.035634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 322/641] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:01.051419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:01.104991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c116-c343-457b-b4d5-8d668b499aaa None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:01.143667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea21e2-ad59-4534-87ba-de5f04d87d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:01.144341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea21e2-ad59-4534-87ba-de5f04d87d87 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:01.144618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea21e2-ad59-4534-87ba-de5f04d87d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:01.144885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea21e2-ad59-4534-87ba-de5f04d87d87 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:01.145551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea21e2-ad59-4534-87ba-de5f04d87d87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:01.146954 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea21e2-ad59-4534-87ba-de5f04d87d87 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:01.174859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 320/642] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:47:00 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:47:01.512683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd09828-55f4-41fb-b921-ad1384e1e805 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:01.513065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd09828-55f4-41fb-b921-ad1384e1e805 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:01.513243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd09828-55f4-41fb-b921-ad1384e1e805 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:01.515234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 323/643] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:01.520564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5720d3a-bf9f-4a8f-9859-d1fbe7a585f8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:01.520853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5720d3a-bf9f-4a8f-9859-d1fbe7a585f8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:01.521126 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5720d3a-bf9f-4a8f-9859-d1fbe7a585f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:01.540153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f5720d3a-bf9f-4a8f-9859-d1fbe7a585f8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:01.541342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f5720d3a-bf9f-4a8f-9859-d1fbe7a585f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:01.621075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 321/644] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:01.890116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd09828-55f4-41fb-b921-ad1384e1e805 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:01.948437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dee87-3548-4b7a-afe2-fe6df5addf8b None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:01.948728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dee87-3548-4b7a-afe2-fe6df5addf8b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:01.949010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dee87-3548-4b7a-afe2-fe6df5addf8b None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:01.954141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 322/645] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:47:01.956092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b907-1e15-44f7-8a28-c176ac44f584 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:01.956626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b907-1e15-44f7-8a28-c176ac44f584 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:01.957101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b907-1e15-44f7-8a28-c176ac44f584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:01.975630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e856b907-1e15-44f7-8a28-c176ac44f584 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:01.977296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e856b907-1e15-44f7-8a28-c176ac44f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:02.010160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd09828-55f4-41fb-b921-ad1384e1e805 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:02.015458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:02.039801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:02.054799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94703b3e-ddb5-4fe0-9ea2-982426848931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:02.055603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94703b3e-ddb5-4fe0-9ea2-982426848931 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:02.055886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94703b3e-ddb5-4fe0-9ea2-982426848931 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:02.056156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94703b3e-ddb5-4fe0-9ea2-982426848931 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:02.070585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94703b3e-ddb5-4fe0-9ea2-982426848931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:47:02.071172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 323/646] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-94703b3e-ddb5-4fe0-9ea2-982426848931 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:47:02.073727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:02.074720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 16:47:02.075573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:02.083880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 324/647] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Oct 10 16:47:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:02.090062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856b907-1e15-44f7-8a28-c176ac44f584 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:02.199341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856b907-1e15-44f7-8a28-c176ac44f584 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:02.234734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:02.235339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:02.235621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:02.235894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:02.236560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:02.236862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:02.238236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:02.247113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 324/648] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Oct 10 16:47:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:02.255624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94703b3e-ddb5-4fe0-9ea2-982426848931 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:02.364037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94703b3e-ddb5-4fe0-9ea2-982426848931 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:02.395059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:02.403454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:02.404159 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:02.404437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:02.404735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:02.416261 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:02.417714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:02.433638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:02.434812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:02.435722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:02.435722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:02.435722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:02.435929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:02.439510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 325/649] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:02.446380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:02.498207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:02.528888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b83a-5450-480d-81e4-8690ed8f2161 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:02.572451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:02.573263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:02.573782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:02.574249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:02.574414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac635322-88c9-495d-95ce-c90ad6a642b8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:02.575009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:02.577266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:02.588320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:02.589823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:02.591015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:02.595201 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 325/650] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:02.597045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:02.615881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:02.616548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:02.617396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:02.617674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:02.618415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:02.618777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:02.620144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:02.636315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 326/651] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:02.642992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:02.719161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:02.729982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7677db-ad08-43cc-9bb1-e97dec53e8ca None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:02.746359 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:02.755164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30f61-e5ef-41c4-8c8c-acb217d40996 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:02.782715 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:02.783983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:02.784909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:02.785648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:02.786537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:02.787265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:02.789879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:02.797793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:02.798427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:02.798901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:02.799081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:02.799672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 326/652] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:02.806667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:02.806990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:02.808439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:47:02.822392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:02.824276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:02.826027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 327/653] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Oct 10 16:47:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:02.831230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:02.942060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31459aa9-b632-460d-a15a-7f3352a1687d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:02.979871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:02.980475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:02.980749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:02.981020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:02.981803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:02.982054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:02.983659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:02.986119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7b553-cf21-4de7-9270-7a843849bf31 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:03.004735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 328/654] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Oct 10 16:47:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:03.010389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:03.046169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:03.046677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:03.049151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.049801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.051376 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.052271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:03.053084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:03.055504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:03.068930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 327/655] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:03.140737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7777-136f-427c-82ed-0492fa1abf3a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:03.179147 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:03.179791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.180071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.180341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.192833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:03.194371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:03.211354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:03.212365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:03.213263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:03.213263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:03.213263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:03.216755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 329/656] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:03.219375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:03.243274 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:03.333911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fe17f-6807-4a52-aac8-3b6981140323 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:03.376719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abddf2-6d50-40f1-a0c0-4733b6e6f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:03.377342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abddf2-6d50-40f1-a0c0-4733b6e6f333 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.377620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abddf2-6d50-40f1-a0c0-4733b6e6f333 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.377896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abddf2-6d50-40f1-a0c0-4733b6e6f333 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.378654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abddf2-6d50-40f1-a0c0-4733b6e6f333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:03.378962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abddf2-6d50-40f1-a0c0-4733b6e6f333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:03.380336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abddf2-6d50-40f1-a0c0-4733b6e6f333 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:03.397934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 328/657] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:03.399499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:03.469246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df4857-019a-43eb-a3c0-f7a677ff4745 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.469444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df4857-019a-43eb-a3c0-f7a677ff4745 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.469666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df4857-019a-43eb-a3c0-f7a677ff4745 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.471279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 329/658] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:03.473078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:03.476139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90a6d-104b-4a26-baab-a7898c8bbf54 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.476649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90a6d-104b-4a26-baab-a7898c8bbf54 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.477127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90a6d-104b-4a26-baab-a7898c8bbf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.505276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-cdc90a6d-104b-4a26-baab-a7898c8bbf54 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:03.507131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cdc90a6d-104b-4a26-baab-a7898c8bbf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:03.517372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c54d-5958-4b85-9b1c-2e6bc8ca600f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:03.555205 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e01fea-2771-4011-af13-82a770e12896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:03.555837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e01fea-2771-4011-af13-82a770e12896 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.556117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e01fea-2771-4011-af13-82a770e12896 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.556387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e01fea-2771-4011-af13-82a770e12896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.563312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e01fea-2771-4011-af13-82a770e12896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:03.564747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e01fea-2771-4011-af13-82a770e12896 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-42e01fea-2771-4011-af13-82a770e12896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:47:03.576545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:03.577663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:03.578570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 330/659] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:03.579840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2b366-5778-44c3-96f2-d729780e503f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.580120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2b366-5778-44c3-96f2-d729780e503f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.580391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2b366-5778-44c3-96f2-d729780e503f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.582675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 331/660] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:03.584347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2b366-5778-44c3-96f2-d729780e503f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:03.593191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 330/661] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:03 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:03.594872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96be2b-140d-451b-bcab-6f2288a03e13 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.595392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96be2b-140d-451b-bcab-6f2288a03e13 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.595899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96be2b-140d-451b-bcab-6f2288a03e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.614386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0a96be2b-140d-451b-bcab-6f2288a03e13 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:03.615868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0a96be2b-140d-451b-bcab-6f2288a03e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:03.619532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:03.689812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 331/662] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:03 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:03.716829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2b366-5778-44c3-96f2-d729780e503f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:03.741452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:03.754510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:03.755376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.755836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.756312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.757176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:03.757669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:03.759299 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:03.777211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 332/663] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:03.778764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96be2b-140d-451b-bcab-6f2288a03e13 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:03.871052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:03.887759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96be2b-140d-451b-bcab-6f2288a03e13 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:03.929845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c9ed-a69e-44c4-86ce-061fe2117fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:03.930632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c9ed-a69e-44c4-86ce-061fe2117fc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:03.930976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c9ed-a69e-44c4-86ce-061fe2117fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:03.931316 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c9ed-a69e-44c4-86ce-061fe2117fc8 None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/0bda53b55a944877893a20c799fb7c8e/roles/b8634c0b048043c88b5008f2ef802b36` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:03.933612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2c9ed-a69e-44c4-86ce-061fe2117fc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=0bda53b55a944877893a20c799fb7c8e, role_id=b8634c0b048043c88b5008f2ef802b36)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:03.935300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2c9ed-a69e-44c4-86ce-061fe2117fc8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:03.947202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:03.958561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 332/664] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:47:03 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/0bda53b55a944877893a20c799fb7c8e/roles/b8634c0b048043c88b5008f2ef802b36 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:47:03.966267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c9ed-a69e-44c4-86ce-061fe2117fc8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:04.009636 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4e3f-9880-41c8-abf5-7cbbf36a7022 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:04.061630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0c06a-f07f-422a-bdf8-425be46183e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:04.062256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0c06a-f07f-422a-bdf8-425be46183e8 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:04.062544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0c06a-f07f-422a-bdf8-425be46183e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:04.062853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0c06a-f07f-422a-bdf8-425be46183e8 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:04.063561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0c06a-f07f-422a-bdf8-425be46183e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:04.065010 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0c06a-f07f-422a-bdf8-425be46183e8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:04.087291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 333/665] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:47:03 2022] POST /identity/v3/services => generated 241 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:47:04.128590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c9ed-a69e-44c4-86ce-061fe2117fc8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:04.177779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66748-038e-400a-8465-885258b27886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:04.178485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66748-038e-400a-8465-885258b27886 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:04.178791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66748-038e-400a-8465-885258b27886 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:04.179053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66748-038e-400a-8465-885258b27886 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:04.179691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66748-038e-400a-8465-885258b27886 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:04.181099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66748-038e-400a-8465-885258b27886 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-0ad66748-038e-400a-8465-885258b27886 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:04.191624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:04.192823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:47:04.193721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:04.196271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 333/666] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Oct 10 16:47:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:04.203318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0c06a-f07f-422a-bdf8-425be46183e8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:04.255660 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:04.322337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0c06a-f07f-422a-bdf8-425be46183e8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:04.358351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:04.359061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:04.359337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:04.359606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:04.360243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:04.360543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:04.361906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:04.366892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 334/667] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:04.372691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66748-038e-400a-8465-885258b27886 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:04.434417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:04.478399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66748-038e-400a-8465-885258b27886 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:04.515038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:04.515699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:04.515974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:04.516242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:04.516914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:04.517276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:04.518754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:04.523961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 334/668] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:04.530776 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:04.638472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ad9d6-b64f-48a2-9c83-36f20e3f001e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:04.647977 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:04.680569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f4104-3ed6-4e47-a29c-26506596e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:04.681178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4104-3ed6-4e47-a29c-26506596e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:04.681457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4104-3ed6-4e47-a29c-26506596e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:04.681729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f4104-3ed6-4e47-a29c-26506596e2c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:04.682427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f4104-3ed6-4e47-a29c-26506596e2c7 None admin] RBAC: Adding query filter params (interface=public, service_id=d32f42417b0849f3b2dadd3948e9eaa0, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:04.682771 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f4104-3ed6-4e47-a29c-26506596e2c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:04.684125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f4104-3ed6-4e47-a29c-26506596e2c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:04.689861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 335/669] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Oct 10 16:47:04 2022] GET /identity/v3/endpoints?service_id=d32f42417b0849f3b2dadd3948e9eaa0&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:04.695173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:04.800152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ab40-1352-4098-8e10-6e07202668e1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:04.834897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:04.839865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b13f1-cef3-4cc7-8757-19a02c1d6f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:04.840714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b13f1-cef3-4cc7-8757-19a02c1d6f52 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:04.841199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b13f1-cef3-4cc7-8757-19a02c1d6f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:04.841673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b13f1-cef3-4cc7-8757-19a02c1d6f52 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:04.842735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b13f1-cef3-4cc7-8757-19a02c1d6f52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:04.844320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b13f1-cef3-4cc7-8757-19a02c1d6f52 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:04.851103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 335/670] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:47:04 2022] GET /identity/v3/services => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:47:05.374492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337775-28c4-4c63-b1b9-0b1d9853c090 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:05.375108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337775-28c4-4c63-b1b9-0b1d9853c090 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:05.375108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337775-28c4-4c63-b1b9-0b1d9853c090 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:05.376902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 336/671] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:05.383526 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f976b-512e-4d54-8ecc-3a92f14c9d12 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:05.383815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f976b-512e-4d54-8ecc-3a92f14c9d12 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:05.384097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f976b-512e-4d54-8ecc-3a92f14c9d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:05.402896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d46f976b-512e-4d54-8ecc-3a92f14c9d12 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:05.404086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d46f976b-512e-4d54-8ecc-3a92f14c9d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:05.473479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 336/672] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:05 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:05.739590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337775-28c4-4c63-b1b9-0b1d9853c090 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:05.847269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337775-28c4-4c63-b1b9-0b1d9853c090 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:05.882817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef799c4d-1728-4e5e-a29d-ba16ee807c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:05.883012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799c4d-1728-4e5e-a29d-ba16ee807c00 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:05.883232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799c4d-1728-4e5e-a29d-ba16ee807c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:05.883461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799c4d-1728-4e5e-a29d-ba16ee807c00 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:05.884137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef799c4d-1728-4e5e-a29d-ba16ee807c00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:05.885504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef799c4d-1728-4e5e-a29d-ba16ee807c00 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:05.905991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 337/673] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:47:05 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:06.294669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93256304-b815-4936-be33-6fa94393ea8a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:06.296535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93256304-b815-4936-be33-6fa94393ea8a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:06.297024 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93256304-b815-4936-be33-6fa94393ea8a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:06.298910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 337/674] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:06.304588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c7db-70d6-4cf9-8a88-c0fced224c2d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:06.305156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c7db-70d6-4cf9-8a88-c0fced224c2d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:06.305638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c7db-70d6-4cf9-8a88-c0fced224c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:06.327373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5e75c7db-70d6-4cf9-8a88-c0fced224c2d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:06.329014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5e75c7db-70d6-4cf9-8a88-c0fced224c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:06.359116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:06.417215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 338/675] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:06.436365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9368af-9a33-42b1-8912-c8604957ac15 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:06.436365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9368af-9a33-42b1-8912-c8604957ac15 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:06.436365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9368af-9a33-42b1-8912-c8604957ac15 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:06.436988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 338/676] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:06.442473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10098-969e-48c9-8f61-8dc314675d33 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:06.442954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10098-969e-48c9-8f61-8dc314675d33 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:06.443397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10098-969e-48c9-8f61-8dc314675d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:06.463104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d4a10098-969e-48c9-8f61-8dc314675d33 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:06.464505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4a10098-969e-48c9-8f61-8dc314675d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:06.539546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 339/677] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:06.691772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9368af-9a33-42b1-8912-c8604957ac15 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:06.799389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9368af-9a33-42b1-8912-c8604957ac15 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:06.818801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:06.826857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10098-969e-48c9-8f61-8dc314675d33 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:06.836079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee956-4b54-4af8-9ec7-c64b98836358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:06.836722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee956-4b54-4af8-9ec7-c64b98836358 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:06.837010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee956-4b54-4af8-9ec7-c64b98836358 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:06.837267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee956-4b54-4af8-9ec7-c64b98836358 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:06.848583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ee956-4b54-4af8-9ec7-c64b98836358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-8f6ee956-4b54-4af8-9ec7-c64b98836358 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:47:06.853596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:06.854577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 16:47:06.855489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:06.860313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 339/678] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Oct 10 16:47:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:06.861585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee956-4b54-4af8-9ec7-c64b98836358 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:06.945787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:06.961817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10098-969e-48c9-8f61-8dc314675d33 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:06.985371 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee956-4b54-4af8-9ec7-c64b98836358 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.001972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.002853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.003284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.003706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.004583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.006421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:07.016958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:07.018244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:07.019306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:07.021477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 340/679] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:07.026953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.027625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.028240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.028577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.028849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.029596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:07.029903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.031681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.041071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 340/680] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Oct 10 16:47:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:07.047979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.094019 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:07.148996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ca385-4232-492f-95e6-9beff8938101 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.155614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de2e61-85c4-4a19-8bd9-9fd34e88a564 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.185464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cd183-5a26-4ad6-bfca-242301b061d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.186099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd183-5a26-4ad6-bfca-242301b061d8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.186455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd183-5a26-4ad6-bfca-242301b061d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.186725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd183-5a26-4ad6-bfca-242301b061d8 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.187311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cd183-5a26-4ad6-bfca-242301b061d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:07.187614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cd183-5a26-4ad6-bfca-242301b061d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.188972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cd183-5a26-4ad6-bfca-242301b061d8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.190405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04b2e8-5990-4da0-9be8-541f49b4ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.191060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b2e8-5990-4da0-9be8-541f49b4ce51 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.191340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b2e8-5990-4da0-9be8-541f49b4ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.191613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b2e8-5990-4da0-9be8-541f49b4ce51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.198851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 341/681] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:07.199948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d03b4-d0eb-4363-b5a5-ca7fbb3164df None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.200242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d03b4-d0eb-4363-b5a5-ca7fbb3164df None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.200524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d03b4-d0eb-4363-b5a5-ca7fbb3164df None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.206494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 342/682] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:07.206494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d03b4-d0eb-4363-b5a5-ca7fbb3164df None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.207830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04b2e8-5990-4da0-9be8-541f49b4ce51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.210555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04b2e8-5990-4da0-9be8-541f49b4ce51 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.223566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-2b04b2e8-5990-4da0-9be8-541f49b4ce51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:07.225458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:07.226771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:07.228595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:07.228595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:07.228595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:07.231433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 341/683] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:07.233578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d55e-5786-4288-9266-39fe9e1055bc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.233866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d55e-5786-4288-9266-39fe9e1055bc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.234145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d55e-5786-4288-9266-39fe9e1055bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.253044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4b58d55e-5786-4288-9266-39fe9e1055bc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:07.254215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4b58d55e-5786-4288-9266-39fe9e1055bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:07.313297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d03b4-d0eb-4363-b5a5-ca7fbb3164df None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.330725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 342/684] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:07.330725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d55e-5786-4288-9266-39fe9e1055bc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.354803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.355406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.355681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.355957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.356623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:07.356919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.359152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.365520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:07.369138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 343/685] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:07.369968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.464505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d55e-5786-4288-9266-39fe9e1055bc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.465386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:07.489813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc029f-1ee8-48ab-a579-6f6d004edf10 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.505961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.506639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.507264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.507264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.507901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:07.508202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.509687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.522562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 343/686] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:07.527852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.535692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.536474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.536849 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.537224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.538059 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] RBAC: Adding query filter params (interface=public, service_id=ec539820e65d4096b369003c8e19066e, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:07.538470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.540598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.548230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 344/687] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/endpoints?service_id=ec539820e65d4096b369003c8e19066e&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:07.553309 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.639697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:07.659099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbdca9-57c0-4e1b-8795-800a17cb4543 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.662927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db03b12-00f7-423d-b6d2-124fd45397cc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.695382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3a59-481a-49f2-9482-4e5562647b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.695993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3a59-481a-49f2-9482-4e5562647b97 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.696281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3a59-481a-49f2-9482-4e5562647b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.696555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b3a59-481a-49f2-9482-4e5562647b97 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.697201 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b3a59-481a-49f2-9482-4e5562647b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.698570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b3a59-481a-49f2-9482-4e5562647b97 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.701814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.702689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.702968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.703238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.705275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 345/688] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:47:07.706093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3a59-481a-49f2-9482-4e5562647b97 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.719084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:07.719806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.723106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:47:07.742733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:07.743748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 16:47:07.744735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:07.748057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 344/689] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:07.755558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.848919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b3a59-481a-49f2-9482-4e5562647b97 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.882183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf740a-b3f6-425f-bf3e-313a395dd360 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:07.897382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.898031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.898315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.899873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.899979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.901387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:07.913964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:07.916156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 16:47:07.917127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:07.920538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 346/690] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:07.921979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:07.929382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:07.932104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:07.932104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:07.932104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:07.932104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:07.932104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:07.934609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:07.955839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:07.962673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 345/691] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:07.968166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:08.012158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:08.046602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029cd3-553e-42c1-a448-d1c2d62aa48d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:08.088332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:08.089279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.089737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.090214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.091120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:08.091611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:08.093892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:08.104512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 347/692] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:08.106119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:08.109889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c587ef-a63f-47b6-9277-6b6e4c52ee56 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:08.155046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937e3fb-5103-4da5-82bb-5a513077874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:08.155670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937e3fb-5103-4da5-82bb-5a513077874a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.155943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937e3fb-5103-4da5-82bb-5a513077874a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.156373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937e3fb-5103-4da5-82bb-5a513077874a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.219402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70605-9a79-4f4f-898a-e4b621628e0b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:08.236022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:08.238432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937e3fb-5103-4da5-82bb-5a513077874a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:08.240058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937e3fb-5103-4da5-82bb-5a513077874a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:08.259607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd432b9-8a38-4a3c-86b1-8f11d4cbbd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:08.260139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd432b9-8a38-4a3c-86b1-8f11d4cbbd95 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.260422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd432b9-8a38-4a3c-86b1-8f11d4cbbd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.260697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd432b9-8a38-4a3c-86b1-8f11d4cbbd95 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.261332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd432b9-8a38-4a3c-86b1-8f11d4cbbd95 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:08.261638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd432b9-8a38-4a3c-86b1-8f11d4cbbd95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:08.263078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd432b9-8a38-4a3c-86b1-8f11d4cbbd95 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:08.266040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:08.273808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 348/693] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:08.273808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b234-0535-4e12-a27c-0d12b2442b0e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.273808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b234-0535-4e12-a27c-0d12b2442b0e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.273808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b234-0535-4e12-a27c-0d12b2442b0e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.273808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 349/694] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:08.277100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70b234-0535-4e12-a27c-0d12b2442b0e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:08.350999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 346/695] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:47:07 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:47:08.352279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716be8-76dc-4153-a1a3-26cb4dc7ff91 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.352566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716be8-76dc-4153-a1a3-26cb4dc7ff91 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.352842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716be8-76dc-4153-a1a3-26cb4dc7ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.370911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c2716be8-76dc-4153-a1a3-26cb4dc7ff91 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:08.372106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c2716be8-76dc-4153-a1a3-26cb4dc7ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:08.395385 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70b234-0535-4e12-a27c-0d12b2442b0e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:08.431563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c422458-85d0-41b0-8d25-eeb7d025be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:08.432172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c422458-85d0-41b0-8d25-eeb7d025be2f None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.432645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c422458-85d0-41b0-8d25-eeb7d025be2f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.432753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c422458-85d0-41b0-8d25-eeb7d025be2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.433387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c422458-85d0-41b0-8d25-eeb7d025be2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:08.434779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c422458-85d0-41b0-8d25-eeb7d025be2f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:08.450560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 347/696] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:08.450560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2716be8-76dc-4153-a1a3-26cb4dc7ff91 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:08.471972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 350/697] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:47:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:08.507272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:08.587963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2716be8-76dc-4153-a1a3-26cb4dc7ff91 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:08.637840 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:08.638693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.639114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.639528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.650948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:08.652571 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:08.668555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:08.669726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:08.671653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:08.671653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:08.671653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:08.674551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 348/698] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:08.678261 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c422458-85d0-41b0-8d25-eeb7d025be2f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:08.741598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:08.751959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:08.802962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c422458-85d0-41b0-8d25-eeb7d025be2f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:08.854292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:08.855284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.855899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.856749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.858546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:08.859195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:08.861213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:08.872051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:08.882475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261ecb-5266-49f7-86d2-9ba9cac2c355 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:08.883881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 351/699] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:08.894548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:08.934660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:08.935301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:08.935648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:08.936197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:08.936926 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:08.938911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:08.951047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:08.952103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:08.953359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:08.957771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 349/700] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:08.958694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:09.010066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce7d0-d9c7-4157-941d-9c6715b4f575 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:09.028280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:09.050152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:09.051418 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.051952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.052428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.060171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:09.062022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:47:09.074795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:09.075787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:09.076971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:47:09.076971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:47:09.076971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:47:09.076971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:47:09.076971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:47:09.076971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:47:09.076971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:09.076971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:09.084049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4555bde-154c-41fd-9c1e-6c2ac162c307 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:09.084439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 352/701] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:09.085977 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:09.129523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:09.130543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.131028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.131521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.132400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:09.132912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:09.134548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:09.140870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 350/702] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:09.146409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:09.156919 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:09.207580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7032da-5abb-4901-9505-586e9d9af7e8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:09.245330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:09.246103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.246485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.246881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.247830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:09.248262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:09.250172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:09.269383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 353/703] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:47:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:09.271027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:09.277762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0279-4578-4dac-9735-a0f34f827ad1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:09.310495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:09.321566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:09.322400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.323175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.323741 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.324627 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:09.325084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:09.327395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:09.338620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 351/704] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:09.339990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:09.397134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e2fb3-5f8c-46d8-930a-89e4ed4d5a18 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:09.423652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:09.443460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:09.444724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.445160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.445587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.446513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] RBAC: Adding query filter params (role.id=b8634c0b048043c88b5008f2ef802b36, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=0bda53b55a944877893a20c799fb7c8e) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:09.447011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:09.449483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:09.458376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 354/705] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:47:09 2022] GET /identity/v3/role_assignments?user.id=0bda53b55a944877893a20c799fb7c8e&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=b8634c0b048043c88b5008f2ef802b36 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:09.467293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ab012-f7c1-4205-81d7-8dffce0f16c2 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:09.508809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda300a-ecf2-4e26-8e3d-bad2221649ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:09.509839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda300a-ecf2-4e26-8e3d-bad2221649ee None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.510348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda300a-ecf2-4e26-8e3d-bad2221649ee None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.510969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda300a-ecf2-4e26-8e3d-bad2221649ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.511914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda300a-ecf2-4e26-8e3d-bad2221649ee None admin] RBAC: Adding query filter params (interface=public, service_id=9223f3d64f2e44eda32329a84bdd1dd1, region_id=RegionOne) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:09.512485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda300a-ecf2-4e26-8e3d-bad2221649ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:09.514696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda300a-ecf2-4e26-8e3d-bad2221649ee None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:09.521495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 352/706] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Oct 10 16:47:09 2022] GET /identity/v3/endpoints?service_id=9223f3d64f2e44eda32329a84bdd1dd1&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:09.527785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:09.638749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:09.642588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38ead6-a3fb-4a22-846c-1c2105acb2eb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:09.679796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f50c1c-5e00-470a-bb30-ce7e771c76c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:09.680503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50c1c-5e00-470a-bb30-ce7e771c76c6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.680898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50c1c-5e00-470a-bb30-ce7e771c76c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.681280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f50c1c-5e00-470a-bb30-ce7e771c76c6 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.682003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f50c1c-5e00-470a-bb30-ce7e771c76c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:09.683499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f50c1c-5e00-470a-bb30-ce7e771c76c6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:09.690136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 355/707] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:47:09 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:47:09.933789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac093-a081-4d03-bd9c-82bdccf21541 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.934103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac093-a081-4d03-bd9c-82bdccf21541 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.934284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac093-a081-4d03-bd9c-82bdccf21541 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.936491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 353/708] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:09.941830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc727-81ad-43a2-b7b5-335f8d8408f7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:09.942118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc727-81ad-43a2-b7b5-335f8d8408f7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:09.942392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc727-81ad-43a2-b7b5-335f8d8408f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:09.962285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d6bfc727-81ad-43a2-b7b5-335f8d8408f7 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:09.963504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6bfc727-81ad-43a2-b7b5-335f8d8408f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:10.034781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 356/709] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:10.306122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ac093-a081-4d03-bd9c-82bdccf21541 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:10.410229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ac093-a081-4d03-bd9c-82bdccf21541 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:10.448031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:10.448653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:10.448965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:10.449178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:10.449754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:10.451194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:10.453592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:10.461125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:10.462330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:10.464261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 354/710] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:10.469798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfc727-81ad-43a2-b7b5-335f8d8408f7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:10.570560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:10.578686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfc727-81ad-43a2-b7b5-335f8d8408f7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:10.614702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2663e-678b-49ca-9ab7-9603904aacea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:10.615676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2663e-678b-49ca-9ab7-9603904aacea None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:10.616172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2663e-678b-49ca-9ab7-9603904aacea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:10.616653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2663e-678b-49ca-9ab7-9603904aacea None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:10.617499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2663e-678b-49ca-9ab7-9603904aacea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:10.618021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2663e-678b-49ca-9ab7-9603904aacea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:10.619611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2663e-678b-49ca-9ab7-9603904aacea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:10.625282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 357/711] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:10.634463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:10.741414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d091c-4635-4e50-b4ea-11a0c652cbbe None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:10.756136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f652b3-0190-4513-96b3-457928281378 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:10.756452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f652b3-0190-4513-96b3-457928281378 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:10.756694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f652b3-0190-4513-96b3-457928281378 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:10.758227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 358/712] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:10.763236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fed9d-d52f-49fd-adc6-dc817df62365 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:10.763514 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fed9d-d52f-49fd-adc6-dc817df62365 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:10.764301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fed9d-d52f-49fd-adc6-dc817df62365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:10.783683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-577fed9d-d52f-49fd-adc6-dc817df62365 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:10.784875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-577fed9d-d52f-49fd-adc6-dc817df62365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:10.789630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:10.790532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:10.791018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:10.791488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:10.792333 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:10.792876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:10.794497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:10.801070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 355/713] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:10.810167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:10.869541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 359/714] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:47:10.887628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:10.935269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7ccd-967d-414a-9702-395bdcbd79ec None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:10.972054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90b42-df77-413e-b3f2-751c0584fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:10.972656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b42-df77-413e-b3f2-751c0584fd05 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:10.972933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b42-df77-413e-b3f2-751c0584fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:10.973212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b42-df77-413e-b3f2-751c0584fd05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:10.973873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af90b42-df77-413e-b3f2-751c0584fd05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:10.975313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af90b42-df77-413e-b3f2-751c0584fd05 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:11.000935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 356/715] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:47:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:11.142232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fed9d-d52f-49fd-adc6-dc817df62365 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:11.234809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:11.248760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fed9d-d52f-49fd-adc6-dc817df62365 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:11.290265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:11.290984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:11.291264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:11.291536 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:11.292114 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:11.293454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:11.302640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:11.303628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:11.304455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 360/716] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:47:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:11.309809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90b42-df77-413e-b3f2-751c0584fd05 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:11.416479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90b42-df77-413e-b3f2-751c0584fd05 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:11.437556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:11.456060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ec94f-e159-4a14-9499-84353ebf0715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:11.456685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec94f-e159-4a14-9499-84353ebf0715 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:11.456960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec94f-e159-4a14-9499-84353ebf0715 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:11.457198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec94f-e159-4a14-9499-84353ebf0715 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:11.457822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ec94f-e159-4a14-9499-84353ebf0715 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:11.458119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ec94f-e159-4a14-9499-84353ebf0715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:11.459586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ec94f-e159-4a14-9499-84353ebf0715 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:11.464801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 357/717] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:47:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:11.470470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:11.578558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497635-64e4-4561-8d42-820ef916d7d7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:11.614267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb3d1d-bb20-4354-ae51-5c658643649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:11.615312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3d1d-bb20-4354-ae51-5c658643649b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:11.615796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3d1d-bb20-4354-ae51-5c658643649b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:11.616285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3d1d-bb20-4354-ae51-5c658643649b None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:11.617118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb3d1d-bb20-4354-ae51-5c658643649b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:11.617634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb3d1d-bb20-4354-ae51-5c658643649b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:11.619222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb3d1d-bb20-4354-ae51-5c658643649b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:11.625019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 361/718] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:47:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:11.802158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c772bd5-0648-4eca-bb67-f9d99105dc1d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:11.802547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c772bd5-0648-4eca-bb67-f9d99105dc1d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:11.802650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c772bd5-0648-4eca-bb67-f9d99105dc1d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:11.804272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 358/719] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:11.809666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b421-e2b4-4310-99c1-c1280d61f1cd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:11.809961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b421-e2b4-4310-99c1-c1280d61f1cd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:11.810244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b421-e2b4-4310-99c1-c1280d61f1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:11.830191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e2f5b421-e2b4-4310-99c1-c1280d61f1cd None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:11.831428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e2f5b421-e2b4-4310-99c1-c1280d61f1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:11.839622 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:11.914935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 362/720] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:11.977339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02c27-5d33-45cc-bd8b-5e5cc2fb96c5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:11.977981 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02c27-5d33-45cc-bd8b-5e5cc2fb96c5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:11.978494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02c27-5d33-45cc-bd8b-5e5cc2fb96c5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:11.980347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 359/721] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:11.988731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feedff3-fce0-4b6b-8c3b-0ed04469f75e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:11.989398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feedff3-fce0-4b6b-8c3b-0ed04469f75e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:11.989884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feedff3-fce0-4b6b-8c3b-0ed04469f75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:12.010301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7feedff3-fce0-4b6b-8c3b-0ed04469f75e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:12.011527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7feedff3-fce0-4b6b-8c3b-0ed04469f75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:12.081033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 363/722] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:12.188516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02c27-5d33-45cc-bd8b-5e5cc2fb96c5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:12.296259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02c27-5d33-45cc-bd8b-5e5cc2fb96c5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:12.332264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:12.333190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:12.333612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:12.334029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] PATH_INFO: `/v3/services/image` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:12.334785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:12.336411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:12.346041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:12.347258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:12.348282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:12.350618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 360/723] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Oct 10 16:47:12 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:12.358877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feedff3-fce0-4b6b-8c3b-0ed04469f75e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:12.364105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:12.419608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:12.444877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:12.477740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c365a-a319-4f70-a085-1cef486b3359 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:12.478969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feedff3-fce0-4b6b-8c3b-0ed04469f75e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:12.517705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:12.518669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:12.519095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:12.519520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:12.520116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:12.521382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:12.521529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:12.522267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:12.522720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:12.523151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:12.524048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] RBAC: Adding query filter params (name=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:12.524584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:12.526065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:12.532507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:12.534448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 16:47:12.536174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:12.538643 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 361/724] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:12.539218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 364/725] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:12.539870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:12.546562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:12.642182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981882-6dbc-4c9f-af8c-18afc38aab6a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:12.652449 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:12.659070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7fc64-f328-4234-b0ac-9c6dbfc26a22 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:12.678002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:12.678549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:12.678822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:12.679099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:12.679725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:12.680026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:12.681585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:12.691047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 362/726] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:12.692307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:12.700324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:12.701286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:12.701763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:12.702183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:12.703034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] RBAC: Adding query filter params (type=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:12.703552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:12.705176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:12.707640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:12.718641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 365/727] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:12.806327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9505-901a-495c-99e9-e636442f15b8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:12.845447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3f345-e637-47e9-afaf-bf484ee192f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:12.846065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f345-e637-47e9-afaf-bf484ee192f2 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:12.846342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f345-e637-47e9-afaf-bf484ee192f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:12.846648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f345-e637-47e9-afaf-bf484ee192f2 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:12.847402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3f345-e637-47e9-afaf-bf484ee192f2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:12.847708 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3f345-e637-47e9-afaf-bf484ee192f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:12.849097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3f345-e637-47e9-afaf-bf484ee192f2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:12.858679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 363/728] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Oct 10 16:47:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:12.861241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:12.984339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc4b6-8be2-4a6b-92c7-a7bbc4991573 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:13.020169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269a8f2-6196-4731-ad39-e6ba00632cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:13.020779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a8f2-6196-4731-ad39-e6ba00632cf5 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:13.021057 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a8f2-6196-4731-ad39-e6ba00632cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:13.021391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a8f2-6196-4731-ad39-e6ba00632cf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:13.022080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269a8f2-6196-4731-ad39-e6ba00632cf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:13.023461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269a8f2-6196-4731-ad39-e6ba00632cf5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:13.047341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 366/729] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:47:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:13.366217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b312ec6-e8c6-4731-9377-a703b457915d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:13.366671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b312ec6-e8c6-4731-9377-a703b457915d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:13.367133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b312ec6-e8c6-4731-9377-a703b457915d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:13.368865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 364/730] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:13.374320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004bdc-05a7-4454-97f1-33eb73da41d6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:13.374629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004bdc-05a7-4454-97f1-33eb73da41d6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:13.374903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004bdc-05a7-4454-97f1-33eb73da41d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:13.394067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-21004bdc-05a7-4454-97f1-33eb73da41d6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:13.395389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-21004bdc-05a7-4454-97f1-33eb73da41d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:13.456096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:13.479358 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 367/731] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:13.757140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b312ec6-e8c6-4731-9377-a703b457915d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:13.799613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:13.832070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404052e-df59-4488-af54-7e12d5ea5242 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:13.832587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404052e-df59-4488-af54-7e12d5ea5242 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:13.832663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404052e-df59-4488-af54-7e12d5ea5242 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:13.834073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 368/732] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:13.839294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccfcbe-2f78-4f13-93dd-23f99eff61e1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:13.839813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccfcbe-2f78-4f13-93dd-23f99eff61e1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:13.840329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccfcbe-2f78-4f13-93dd-23f99eff61e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:13.861316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c6ccfcbe-2f78-4f13-93dd-23f99eff61e1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:13.863060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c6ccfcbe-2f78-4f13-93dd-23f99eff61e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:13.867884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b312ec6-e8c6-4731-9377-a703b457915d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:13.905831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:13.905987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:13.906359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:13.906809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:13.907403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:13.908837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:13.918003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:13.919028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:13.920416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 365/733] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:13.926070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:13.946210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 369/734] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:47:14.036124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38517-b68a-49d9-a255-697bb8bd0f17 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:14.037628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:14.074388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:14.075033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:14.075308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:14.075578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:14.077144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:14.077453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:14.078835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:14.089249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 366/735] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:14.090835 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccfcbe-2f78-4f13-93dd-23f99eff61e1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:14.198164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccfcbe-2f78-4f13-93dd-23f99eff61e1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:14.212171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:14.234593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:14.235200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:14.235476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:14.235744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:14.236370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:14.236714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:14.238066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:14.238678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:14.243378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 370/736] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:14.249235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:14.349896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90c3a-78b3-4055-9e9d-d4329a2ab569 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:14.350076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d00f1-9a09-4355-9d57-b9a3d7065880 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:14.385964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:14.386626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:14.386906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:14.387174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:14.387949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ee04e-537d-4d96-9451-bfe82ce83e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:14.388103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] RBAC: Adding query filter params (interface=admin, service_id=ec539820e65d4096b369003c8e19066e, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:14.388268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:14.389070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ee04e-537d-4d96-9451-bfe82ce83e43 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:14.389450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ee04e-537d-4d96-9451-bfe82ce83e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:14.389729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:14.389906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ee04e-537d-4d96-9451-bfe82ce83e43 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:14.390707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ee04e-537d-4d96-9451-bfe82ce83e43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:14.392319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ee04e-537d-4d96-9451-bfe82ce83e43 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:14.395293 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 371/737] 10.222.0.27 () {56 vars in 1249 bytes} [Mon Oct 10 16:47:14 2022] GET /identity/v3/endpoints?service_id=ec539820e65d4096b369003c8e19066e&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:14.400844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:14.419228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 367/738] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:47:14 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:14.470001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:14.542369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98921-0997-497a-912e-9249c8dd3673 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:14.595267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d4605-72bc-4493-bbeb-b2760d7c991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:14.595939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4605-72bc-4493-bbeb-b2760d7c991f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:14.596219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4605-72bc-4493-bbeb-b2760d7c991f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:14.596493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4605-72bc-4493-bbeb-b2760d7c991f None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:14.597104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d4605-72bc-4493-bbeb-b2760d7c991f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:14.598467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d4605-72bc-4493-bbeb-b2760d7c991f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:14.605747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 372/739] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:47:14 2022] GET /identity/v3/services => generated 1727 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:47:15.007994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4726-e9c0-4030-8726-1ec96c955974 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:15.008508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4726-e9c0-4030-8726-1ec96c955974 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:15.008608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4726-e9c0-4030-8726-1ec96c955974 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:15.010131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 368/740] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:15.015761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c6269-76ac-4230-acd5-e2244418fb8d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:15.016162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c6269-76ac-4230-acd5-e2244418fb8d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:15.016382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c6269-76ac-4230-acd5-e2244418fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:15.034972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a56c6269-76ac-4230-acd5-e2244418fb8d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:15.036159 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a56c6269-76ac-4230-acd5-e2244418fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:15.109940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 373/741] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:15.305155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58b363-ad1f-40e3-969f-47f96e86dc1e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:15.305346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58b363-ad1f-40e3-969f-47f96e86dc1e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:15.305622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58b363-ad1f-40e3-969f-47f96e86dc1e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:15.307225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 369/742] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:15.313305 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3fc6e-c384-45bf-9e97-02ce91e633df None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:15.313584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3fc6e-c384-45bf-9e97-02ce91e633df None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:15.313850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3fc6e-c384-45bf-9e97-02ce91e633df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:15.332063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b4b3fc6e-c384-45bf-9e97-02ce91e633df None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:15.333251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b4b3fc6e-c384-45bf-9e97-02ce91e633df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:15.360188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:15.381239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58b363-ad1f-40e3-969f-47f96e86dc1e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:15.408681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 374/743] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:15.412026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:15.493945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58b363-ad1f-40e3-969f-47f96e86dc1e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:15.528850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613f54-8afa-4680-98d1-569edea8bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:15.530170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613f54-8afa-4680-98d1-569edea8bec9 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:15.530615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613f54-8afa-4680-98d1-569edea8bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:15.531052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613f54-8afa-4680-98d1-569edea8bec9 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:15.531848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff613f54-8afa-4680-98d1-569edea8bec9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:15.533337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff613f54-8afa-4680-98d1-569edea8bec9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:15.554217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 370/744] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:47:15 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:15.685196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3fc6e-c384-45bf-9e97-02ce91e633df None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:15.791188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3fc6e-c384-45bf-9e97-02ce91e633df None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:15.833890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:15.834896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:15.835455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:15.835930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:15.836795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:15.838407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:15.841214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING keystone.server.flask.common [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 10 16:47:15.863659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.sql.core [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 16:47:15.863659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 16:47:15.863659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [parameters: {'id': 'f03ac77554b7445ba4c598d79e2fd3b3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 10 16:47:15.863659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f03ac77554b7445ba4c598d79e2fd3b3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f03ac77554b7445ba4c598d79e2fd3b3. Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:47:15.871880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 10 16:47:15.872689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application yield resource Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise self.value Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application session.commit() Oct 10 16:47:15.874141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.flush() Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application compat.raise_( Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 16:47:15.875065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 16:47:15.878180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:47:15.879590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [parameters: {'id': 'f03ac77554b7445ba4c598d79e2fd3b3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:15.881420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:15.882211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f03ac77554b7445ba4c598d79e2fd3b3. Oct 10 16:47:15.883139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:15.886781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 375/745] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Oct 10 16:47:15 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:15.893579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613f54-8afa-4680-98d1-569edea8bec9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:15.987976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:16.008118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613f54-8afa-4680-98d1-569edea8bec9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:16.043838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f526288-247a-4792-9ab1-f9ec88660f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:16.045445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f526288-247a-4792-9ab1-f9ec88660f6a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:16.045977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f526288-247a-4792-9ab1-f9ec88660f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:16.046455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f526288-247a-4792-9ab1-f9ec88660f6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:16.054099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f526288-247a-4792-9ab1-f9ec88660f6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:16.055803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f526288-247a-4792-9ab1-f9ec88660f6a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-4f526288-247a-4792-9ab1-f9ec88660f6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:47:16.068064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:16.068963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:16.069846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:47:16.069846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:47:16.069846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:47:16.069846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:47:16.069846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:47:16.069846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:47:16.069846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:16.069846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:16.071357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 371/746] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:16.080067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:16.096396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:16.188702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd426-2e38-4edd-8722-ebeeae0e9354 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:16.224709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57162d-9f2b-406d-b5bc-69d5561f4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:16.225698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57162d-9f2b-406d-b5bc-69d5561f4e36 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:16.226190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57162d-9f2b-406d-b5bc-69d5561f4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:16.226719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57162d-9f2b-406d-b5bc-69d5561f4e36 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:16.227590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57162d-9f2b-406d-b5bc-69d5561f4e36 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:16.228094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57162d-9f2b-406d-b5bc-69d5561f4e36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:16.229967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57162d-9f2b-406d-b5bc-69d5561f4e36 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:16.251729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 376/747] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:47:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:16.673893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0652a02-138a-4d2e-affe-b030b7d0aa08 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:16.674671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0652a02-138a-4d2e-affe-b030b7d0aa08 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:16.675183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0652a02-138a-4d2e-affe-b030b7d0aa08 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:16.676988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 372/748] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:16.682588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f067c3-8f68-4db3-b04a-14d7e5335ba8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:16.683127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f067c3-8f68-4db3-b04a-14d7e5335ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:16.683633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f067c3-8f68-4db3-b04a-14d7e5335ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:16.705405 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c2f067c3-8f68-4db3-b04a-14d7e5335ba8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:16.707265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c2f067c3-8f68-4db3-b04a-14d7e5335ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:16.778045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 377/749] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:16.962504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ded4-ff2b-42f5-aefe-9d04582408c5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:16.962706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ded4-ff2b-42f5-aefe-9d04582408c5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:16.962980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ded4-ff2b-42f5-aefe-9d04582408c5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:16.964555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 373/750] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:16.969940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8eafd-5a5f-4d7a-b9ca-4a0fe70837f3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:16.970476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8eafd-5a5f-4d7a-b9ca-4a0fe70837f3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:16.970985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8eafd-5a5f-4d7a-b9ca-4a0fe70837f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:16.977453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:16.992181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ffc8eafd-5a5f-4d7a-b9ca-4a0fe70837f3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:16.993768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ffc8eafd-5a5f-4d7a-b9ca-4a0fe70837f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:17.067455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 378/751] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:17.075116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776ded4-ff2b-42f5-aefe-9d04582408c5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.181980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776ded4-ff2b-42f5-aefe-9d04582408c5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:17.219982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:17.220525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.220799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.221069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.221647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:17.223041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:17.232012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:17.233592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:17.234424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 374/752] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:47:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:17.240214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8eafd-5a5f-4d7a-b9ca-4a0fe70837f3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.344273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8eafd-5a5f-4d7a-b9ca-4a0fe70837f3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:17.369518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.378722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:17.384839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:17.385873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.386444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.387087 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.388136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:17.389300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] RBAC: Adding query filter params (name=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:17.389604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:17.391409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:17.396906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 379/753] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:47:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:17.402347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.492173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62ffdd-0ac5-44b2-9f4e-b85532b254ce None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:17.507023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcd04f-36cd-4a8b-a006-807cb97281fa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:17.531762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:17.532813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.533382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.533950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.534782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:17.536475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:17.541787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:17.542393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.542705 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.542974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.543597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:17.543893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:17.545798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:17.549100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:17.550053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 16:47:17.550917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:17.559230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 380/755] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:47:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:17.559230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.559683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 375/755] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Oct 10 16:47:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:17.563634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.617852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:17.649911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:17.660552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19180d30-3cf7-4a02-811b-1cff89e51aa1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:17.683457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf21320-0f43-4803-a791-c2b4b13300b6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:17.699713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:17.700332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.700611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.700910 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.701915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] RBAC: Adding query filter params (interface=public, service_id=e975b87b3d7a40128fef3c2f547801d9, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:17.702224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:17.703643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:17.713889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 381/756] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Oct 10 16:47:17 2022] GET /identity/v3/endpoints?service_id=e975b87b3d7a40128fef3c2f547801d9&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:17.714872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.726271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:17.727293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.727844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.728351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.729322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:17.729920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:17.731611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:17.742662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 376/757] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:17.743839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.816916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aa4f9-b761-421a-a894-042503c69e79 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:17.840489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:17.852140 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00f6b0-8670-4ab8-805d-ea80884b9aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:17.852748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f6b0-8670-4ab8-805d-ea80884b9aec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.853027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f6b0-8670-4ab8-805d-ea80884b9aec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.853300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f6b0-8670-4ab8-805d-ea80884b9aec None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.853908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00f6b0-8670-4ab8-805d-ea80884b9aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:17.855406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00f6b0-8670-4ab8-805d-ea80884b9aec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:17.858992 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523421d-8ac6-4ea2-989f-20006c188b89 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:17.862571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 382/758] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:47:17 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:47:17.863915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2367ef-0113-46f6-864f-2e8bb794c575 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.864255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2367ef-0113-46f6-864f-2e8bb794c575 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.864589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2367ef-0113-46f6-864f-2e8bb794c575 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.870653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 383/759] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:17.872135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e4ed-8643-4523-83b6-94458b67c94d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.872502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e4ed-8643-4523-83b6-94458b67c94d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.872883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e4ed-8643-4523-83b6-94458b67c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.903675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:17.905206 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:17.905630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:17.905744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6506e4ed-8643-4523-83b6-94458b67c94d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:17.906180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:17.907086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:17.907222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6506e4ed-8643-4523-83b6-94458b67c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:17.907657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:17.909282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:17.920897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 377/760] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Oct 10 16:47:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:17.922137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:17.925177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:17.996642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 384/761] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:17 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:18.041717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674b40-a3d7-4676-951d-9761cfa8ba87 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:18.080384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580952-5383-43a9-be62-00fb3a006c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:18.080999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580952-5383-43a9-be62-00fb3a006c7c None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:18.081264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580952-5383-43a9-be62-00fb3a006c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:18.081536 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580952-5383-43a9-be62-00fb3a006c7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:18.082265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580952-5383-43a9-be62-00fb3a006c7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:18.083663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580952-5383-43a9-be62-00fb3a006c7c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:18.102630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 378/762] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:47:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:18.274896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e4ed-8643-4523-83b6-94458b67c94d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:18.382076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e4ed-8643-4523-83b6-94458b67c94d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:18.407561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:18.429602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccac6-c2da-4a5f-8373-260f7e533fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:18.430235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccac6-c2da-4a5f-8373-260f7e533fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:18.430511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccac6-c2da-4a5f-8373-260f7e533fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:18.430803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccac6-c2da-4a5f-8373-260f7e533fe5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:18.431473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ccac6-c2da-4a5f-8373-260f7e533fe5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:18.432818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ccac6-c2da-4a5f-8373-260f7e533fe5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9b9ccac6-c2da-4a5f-8373-260f7e533fe5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:18.441823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:18.442949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:18.444001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 385/763] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Oct 10 16:47:18 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:18.451930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580952-5383-43a9-be62-00fb3a006c7c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:18.499735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089e048-3bb9-4681-a4c3-8d0dd91e5379 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:18.500085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089e048-3bb9-4681-a4c3-8d0dd91e5379 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:18.500296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089e048-3bb9-4681-a4c3-8d0dd91e5379 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:18.502172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 386/764] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:18.507238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd614-d94d-45e4-9663-7b4093439670 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:18.507524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd614-d94d-45e4-9663-7b4093439670 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:18.507805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd614-d94d-45e4-9663-7b4093439670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:18.524069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:18.529264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e66fd614-d94d-45e4-9663-7b4093439670 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:18.529264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e66fd614-d94d-45e4-9663-7b4093439670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:18.566995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580952-5383-43a9-be62-00fb3a006c7c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:18.603217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:18.603829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:18.604106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:18.604377 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:18.605009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] RBAC: Adding query filter params (name=image) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:18.605311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:18.606789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:18.612575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 379/765] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:18.612920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 387/766] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:18 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:47:18.617855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:18.727742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6188c0-cf91-4b4b-a053-35bd53790976 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:18.758425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:18.768518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:18.769169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:18.769447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:18.769772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:18.770406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] RBAC: Adding query filter params (type=image) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:18.770733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:18.772100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:18.777340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 380/767] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:18.783910 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fd614-d94d-45e4-9663-7b4093439670 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:18.895258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:18.906788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fd614-d94d-45e4-9663-7b4093439670 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:18.917619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:18.948256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:18.949786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:18.950303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:18.950866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:18.952312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] RBAC: Adding query filter params (interface=public, service_id=00bee5654f604086874b2150baad821f, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:18.952866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:18.955141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:18.967012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 388/768] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Oct 10 16:47:18 2022] GET /identity/v3/endpoints?service_id=00bee5654f604086874b2150baad821f&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:18.968825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:19.023010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b5c5-cea7-4a40-82e4-e9500f7be004 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:19.067872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:19.069067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:19.070055 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:19.070728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:19.071691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:19.073970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:19.080119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING keystone.server.flask.common [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 10 16:47:19.083417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554245-3db1-45a7-8b94-eb1c28521254 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:19.094370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.sql.core [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 16:47:19.094370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 10 16:47:19.094370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [parameters: {'user_id': '8d87f22db2544d91a618aa0d057bbd63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 10 16:47:19.094370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result.read() Oct 10 16:47:19.103299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:47:19.104185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application yield resource Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise self.value Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application session.commit() Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 16:47:19.105275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.session.flush() Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application compat.raise_( Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 16:47:19.106441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:47:19.107573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result.read() Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:47:19.108602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [parameters: {'user_id': '8d87f22db2544d91a618aa0d057bbd63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:19.109618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 10 16:47:19.110762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 10 16:47:19.111902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 10 16:47:19.111902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 10 16:47:19.111902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 16:47:19.111902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 16:47:19.111902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 10 16:47:19.111902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:19.111902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 381/769] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Oct 10 16:47:18 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:19.114044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:19.135778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39a73-ab26-4c19-86e6-cf3a7c405a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:19.136721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39a73-ab26-4c19-86e6-cf3a7c405a5c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:19.137240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39a73-ab26-4c19-86e6-cf3a7c405a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:19.137701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd39a73-ab26-4c19-86e6-cf3a7c405a5c None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:19.139175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd39a73-ab26-4c19-86e6-cf3a7c405a5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:19.141615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd39a73-ab26-4c19-86e6-cf3a7c405a5c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:19.158619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 389/770] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:47:18 2022] GET /identity/v3/services => generated 1957 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:47:19.178893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:19.240433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719d5e-3793-4ff5-94ed-5c7204aee228 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:19.280927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a77cd-2f65-440c-831d-c6c1dba0e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:19.281572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a77cd-2f65-440c-831d-c6c1dba0e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:19.281847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a77cd-2f65-440c-831d-c6c1dba0e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:19.282114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a77cd-2f65-440c-831d-c6c1dba0e7d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:19.291223 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a77cd-2f65-440c-831d-c6c1dba0e7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:19.292944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a77cd-2f65-440c-831d-c6c1dba0e7d6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-3f9a77cd-2f65-440c-831d-c6c1dba0e7d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:47:19.306955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:19.307998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:19.309579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 382/771] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:47:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:19.315171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39a73-ab26-4c19-86e6-cf3a7c405a5c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:19.354257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:19.426489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd39a73-ab26-4c19-86e6-cf3a7c405a5c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:19.463711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6504d5-b1a0-42bf-9f4e-8c4a219fd858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:19.464610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6504d5-b1a0-42bf-9f4e-8c4a219fd858 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:19.465039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6504d5-b1a0-42bf-9f4e-8c4a219fd858 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:19.465461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6504d5-b1a0-42bf-9f4e-8c4a219fd858 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:19.466319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6504d5-b1a0-42bf-9f4e-8c4a219fd858 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:19.467389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6504d5-b1a0-42bf-9f4e-8c4a219fd858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:19.468983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6504d5-b1a0-42bf-9f4e-8c4a219fd858 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:19.508773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 390/772] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Oct 10 16:47:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:20.243873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0581-0c5f-48b3-8696-bf149eece499 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:20.244369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0581-0c5f-48b3-8696-bf149eece499 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:20.244369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0581-0c5f-48b3-8696-bf149eece499 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:20.248982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 383/773] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:20.255194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a6969-7c45-48e8-8ab5-b247046bc549 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:20.255495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a6969-7c45-48e8-8ab5-b247046bc549 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:20.255753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a6969-7c45-48e8-8ab5-b247046bc549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:20.275728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5d7a6969-7c45-48e8-8ab5-b247046bc549 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:20.276940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5d7a6969-7c45-48e8-8ab5-b247046bc549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:20.347847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 391/774] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:20.378198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29387-85bc-4b90-b8cb-a265afb63684 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:20.378483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29387-85bc-4b90-b8cb-a265afb63684 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:20.378789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29387-85bc-4b90-b8cb-a265afb63684 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:20.380260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 384/775] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:20.385291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffd89e-86ff-41ca-b0dd-78f6cdde86c5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:20.385585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffd89e-86ff-41ca-b0dd-78f6cdde86c5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:20.385865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffd89e-86ff-41ca-b0dd-78f6cdde86c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:20.407913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-68ffd89e-86ff-41ca-b0dd-78f6cdde86c5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:20.409109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-68ffd89e-86ff-41ca-b0dd-78f6cdde86c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:20.427449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:20.480104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 392/776] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:20.614728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29387-85bc-4b90-b8cb-a265afb63684 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:20.714784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29387-85bc-4b90-b8cb-a265afb63684 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:20.727779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:20.749973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:20.750471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffd89e-86ff-41ca-b0dd-78f6cdde86c5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:20.750667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:20.750900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:20.751412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:20.751998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:20.753355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:20.767099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:20.768286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:20.769138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 385/777] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:47:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:20.773961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:20.884876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffd89e-86ff-41ca-b0dd-78f6cdde86c5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:20.896400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95e878-dd94-4277-956b-7b76e6af21bd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:20.926774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275be97-5f58-4685-979b-77837815c3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:20.927413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275be97-5f58-4685-979b-77837815c3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:20.927691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275be97-5f58-4685-979b-77837815c3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:20.928036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275be97-5f58-4685-979b-77837815c3d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:20.929070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275be97-5f58-4685-979b-77837815c3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:20.930481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275be97-5f58-4685-979b-77837815c3d4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:20.932262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:20.932382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 393/778] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:20.932611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:20.932888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:20.933159 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:20.933829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:20.934130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:20.936037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:20.938973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275be97-5f58-4685-979b-77837815c3d4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:20.945927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 386/779] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:47:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:20.946629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:20.965196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:20.990710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:21.046993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275be97-5f58-4685-979b-77837815c3d4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:21.054632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bc40f-084b-49a9-8605-5d5d91b9186f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:21.086379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029109fd-4187-459b-bb5b-e143df348f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:21.087016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029109fd-4187-459b-bb5b-e143df348f2a None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:21.087294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029109fd-4187-459b-bb5b-e143df348f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:21.087595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029109fd-4187-459b-bb5b-e143df348f2a None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:21.088235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029109fd-4187-459b-bb5b-e143df348f2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:21.089063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:21.089667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:21.089765 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029109fd-4187-459b-bb5b-e143df348f2a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:21.089946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:21.090217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:21.090864 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:21.091167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:21.093423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:21.103549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 387/780] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Oct 10 16:47:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:21.103809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:21.131575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 394/781] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:47:20 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:47:21.210462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16fe62-64c7-4255-bd6d-256cf0f408bd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:21.213079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:21.250923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e1e4-4a00-4226-9560-b1b6bb793ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:21.251848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e1e4-4a00-4226-9560-b1b6bb793ad7 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:21.252127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e1e4-4a00-4226-9560-b1b6bb793ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:21.252396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e1e4-4a00-4226-9560-b1b6bb793ad7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:21.253105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e1e4-4a00-4226-9560-b1b6bb793ad7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:21.254568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e1e4-4a00-4226-9560-b1b6bb793ad7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:21.279803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 388/782] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:47:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:47:21.370063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600cb8b-a763-4cfa-a98e-2af80afa2af0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:21.370640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600cb8b-a763-4cfa-a98e-2af80afa2af0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:21.370732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600cb8b-a763-4cfa-a98e-2af80afa2af0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:21.373270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 395/783] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:21.379857 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3e7d6-e60d-4a68-b5b3-1970bd89141f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:21.380173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3e7d6-e60d-4a68-b5b3-1970bd89141f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:21.380395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3e7d6-e60d-4a68-b5b3-1970bd89141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:21.402079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-91a3e7d6-e60d-4a68-b5b3-1970bd89141f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:21.403724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-91a3e7d6-e60d-4a68-b5b3-1970bd89141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:21.491418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 389/784] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:21.761087 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600cb8b-a763-4cfa-a98e-2af80afa2af0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:21.839854 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:21.867927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600cb8b-a763-4cfa-a98e-2af80afa2af0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:21.911135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:21.911774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:21.912048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:21.912324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] PATH_INFO: `/v3/services/image` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:21.912917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:21.914292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:21.923861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:21.924830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:21.927527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 396/785] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Oct 10 16:47:21 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:21.930861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3e7d6-e60d-4a68-b5b3-1970bd89141f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:22.020863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:22.038993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3e7d6-e60d-4a68-b5b3-1970bd89141f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:22.077427 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:22.078055 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:22.078336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:22.078640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:22.079285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:22.079586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:22.080963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:22.090946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 390/786] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:22.092301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:22.195000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2ecf3-735a-4e5f-b17d-784e6cebf3af None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:22.228871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b976a70-1538-43ca-8c9e-fc40e2bae998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:22.229477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976a70-1538-43ca-8c9e-fc40e2bae998 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:22.229750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976a70-1538-43ca-8c9e-fc40e2bae998 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:22.230019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976a70-1538-43ca-8c9e-fc40e2bae998 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:22.230666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b976a70-1538-43ca-8c9e-fc40e2bae998 None admin] RBAC: Adding query filter params (type=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:22.230965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b976a70-1538-43ca-8c9e-fc40e2bae998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:22.232959 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b976a70-1538-43ca-8c9e-fc40e2bae998 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:22.243138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 397/787] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:22.244425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:22.343942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435507ec-8edf-48d9-8ad8-95c19dfd7dc9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:22.377479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bd405-e436-4c13-b48a-94a2639d7b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:22.378074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd405-e436-4c13-b48a-94a2639d7b7f None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:22.378348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd405-e436-4c13-b48a-94a2639d7b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:22.378644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd405-e436-4c13-b48a-94a2639d7b7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:22.379315 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bd405-e436-4c13-b48a-94a2639d7b7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:22.380664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bd405-e436-4c13-b48a-94a2639d7b7f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:22.406571 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 391/788] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:47:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:47:23.351342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71a242-b2dc-434a-84f1-a85d6d8e48f5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:23.351853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71a242-b2dc-434a-84f1-a85d6d8e48f5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:23.351853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71a242-b2dc-434a-84f1-a85d6d8e48f5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:23.353312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 398/789] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:23.358690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05449ac-0656-4061-bd3d-463ea543918f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:23.359084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05449ac-0656-4061-bd3d-463ea543918f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:23.359261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05449ac-0656-4061-bd3d-463ea543918f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:23.372024 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:23.380049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d05449ac-0656-4061-bd3d-463ea543918f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:23.381290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d05449ac-0656-4061-bd3d-463ea543918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:23.462691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 392/790] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:23.539815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c487-5a9e-4827-b828-2abd16e6e848 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:23.540153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c487-5a9e-4827-b828-2abd16e6e848 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:23.540374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c487-5a9e-4827-b828-2abd16e6e848 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:23.541844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 399/791] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:23.547445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afb7a-2673-4833-8c2f-9064868f3f3e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:23.547737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afb7a-2673-4833-8c2f-9064868f3f3e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:23.548013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afb7a-2673-4833-8c2f-9064868f3f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:23.566965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-280afb7a-2673-4833-8c2f-9064868f3f3e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:23.568144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-280afb7a-2673-4833-8c2f-9064868f3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:23.636458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 393/792] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:23.729911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c487-5a9e-4827-b828-2abd16e6e848 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:23.733752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:23.836061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c487-5a9e-4827-b828-2abd16e6e848 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:23.870108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607c5ae-8597-41e9-bc87-bcf6ed20b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:23.870752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607c5ae-8597-41e9-bc87-bcf6ed20b8ec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:23.871029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607c5ae-8597-41e9-bc87-bcf6ed20b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:23.871296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607c5ae-8597-41e9-bc87-bcf6ed20b8ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:23.872460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607c5ae-8597-41e9-bc87-bcf6ed20b8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:23.873864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607c5ae-8597-41e9-bc87-bcf6ed20b8ec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:23.875777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 400/793] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:23.884096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afb7a-2673-4833-8c2f-9064868f3f3e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:23.900991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607c5ae-8597-41e9-bc87-bcf6ed20b8ec None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:23.949893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:23.976956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:24.000017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afb7a-2673-4833-8c2f-9064868f3f3e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:24.010226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607c5ae-8597-41e9-bc87-bcf6ed20b8ec None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:24.036958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717cb67-aded-4237-8470-7d1295861dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:24.037896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717cb67-aded-4237-8470-7d1295861dcb None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.038247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717cb67-aded-4237-8470-7d1295861dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.038544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717cb67-aded-4237-8470-7d1295861dcb None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.039194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717cb67-aded-4237-8470-7d1295861dcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:24.040622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717cb67-aded-4237-8470-7d1295861dcb None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:24.048775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af9279-1643-4efd-b41f-70b6be7d1617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:24.049408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af9279-1643-4efd-b41f-70b6be7d1617 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.049689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af9279-1643-4efd-b41f-70b6be7d1617 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.049962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af9279-1643-4efd-b41f-70b6be7d1617 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.062013 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af9279-1643-4efd-b41f-70b6be7d1617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:47:24.069179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 394/794] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:47:23 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-33af9279-1643-4efd-b41f-70b6be7d1617 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:47:24.069374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:24.070393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:24.071262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 401/795] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Oct 10 16:47:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:24.079897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717cb67-aded-4237-8470-7d1295861dcb None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:24.190616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717cb67-aded-4237-8470-7d1295861dcb None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:24.215798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:24.237345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:24.238027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.238308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.238598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.239382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:24.239685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:24.241060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:24.251536 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 395/796] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Oct 10 16:47:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:24.256608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af9279-1643-4efd-b41f-70b6be7d1617 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:24.364243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af9279-1643-4efd-b41f-70b6be7d1617 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:24.394478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:24.401320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e99e39-ad6e-46be-93ed-db9ee8d48b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:24.401962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99e39-ad6e-46be-93ed-db9ee8d48b7f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.402297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99e39-ad6e-46be-93ed-db9ee8d48b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.402605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99e39-ad6e-46be-93ed-db9ee8d48b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.413459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99e39-ad6e-46be-93ed-db9ee8d48b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:24.414937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99e39-ad6e-46be-93ed-db9ee8d48b7f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-63e99e39-ad6e-46be-93ed-db9ee8d48b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:24.430180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:24.431388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:24.432437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:24.432437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:24.432437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:24.433093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 402/797] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:24.437733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:24.546077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e43a26-0101-4f29-b890-cf8a8569a8c9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:24.580665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:24.581271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.581546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.581814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.582453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:24.583006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:24.584141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:24.584463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5efe5-81fa-4924-b2ee-26e84110ed59 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.584747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5efe5-81fa-4924-b2ee-26e84110ed59 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.585017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5efe5-81fa-4924-b2ee-26e84110ed59 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.586490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 403/798] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:47:24.591941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d0a5-46ba-48cd-8a53-8e188fac4d50 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.592226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d0a5-46ba-48cd-8a53-8e188fac4d50 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.592502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d0a5-46ba-48cd-8a53-8e188fac4d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.602543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 396/799] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:24.602543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:24.616167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-dec2d0a5-46ba-48cd-8a53-8e188fac4d50 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:24.617357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dec2d0a5-46ba-48cd-8a53-8e188fac4d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:24.649982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:24.691850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 404/800] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:47:24.714109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4399-20d4-412f-b2fc-234eddea2853 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:24.749156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:24.749787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.750068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.750393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.758410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:24.759910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:47:24.771341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:24.772292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:47:24.773262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:24.774866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 397/801] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Oct 10 16:47:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:24.778212 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d0a5-46ba-48cd-8a53-8e188fac4d50 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:24.879911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d0a5-46ba-48cd-8a53-8e188fac4d50 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:24.895069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:24.917979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:24.918621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:24.918904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:24.919177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:24.919966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:24.920272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:24.921700 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:24.944003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 405/802] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Oct 10 16:47:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:24.945246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:24.959000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:25.053428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:25.056649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddfac5-43b2-4e9c-8385-55007a04360b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:25.069676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7209-2d91-4c6d-afb7-87a2df093473 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:25.093700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:25.094228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:25.094504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:25.094799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:25.105629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:25.106634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:25.107157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:25.107770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:25.108053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:25.108326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:25.108994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:25.110329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:25.119155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.sql.core [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 10 16:47:25.119155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 16:47:25.119155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [parameters: {'id': '199d0a1e782e4d6aa53e509166f5a4eb', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 10 16:47:25.119155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:25.121629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:25.122958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:25.124528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:25.124528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:25.124528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:25.124528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 398/803] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:25.128855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:47:25.130667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 10 16:47:25.131506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application yield resource Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise self.value Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application session.commit() Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 16:47:25.132528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.flush() Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application compat.raise_( Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 16:47:25.136185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 16:47:25.137512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 16:47:25.140220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [parameters: {'id': '199d0a1e782e4d6aa53e509166f5a4eb', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 10 16:47:25.144283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:25.147049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 406/804] 10.222.0.27 () {60 vars in 1137 bytes} [Mon Oct 10 16:47:24 2022] POST /identity/v3/domains => generated 190 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:25.150382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:25.177947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:25.245256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964797-21bd-425c-9e8a-85b7b783bb0e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:25.250453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692eba2-1ba4-4197-b414-02337871ce5b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:25.283671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:25.284278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:25.284555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:25.284825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:25.285463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:25.285764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:25.286300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:25.286953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:25.287167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:25.287271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:25.287487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:25.298103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:25.299550 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:25.300174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 399/805] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:25.305625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:25.315677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:25.316674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:25.317873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:25.317873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:25.317873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:25.317873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 407/806] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:25.322467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:25.327521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:25.416304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:25.429176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ac1f-c375-438b-803f-4f6c6c2e4b27 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:25.433331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadccba4-402d-4cd9-bc5b-7015853efea8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:25.467657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:25.468931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:25.469435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:25.469929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:25.470875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:25.471478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:25.471762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:25.472058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:25.472845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:25.473168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:25.474870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:25.479154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:25.481031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:47:25.494421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:25.495564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:25.496544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:47:25.496544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:47:25.496544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:47:25.496544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:47:25.496544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:47:25.496544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:47:25.496544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:25.496544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:25.503485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 400/807] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:25.504951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:25.584132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:25.602117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 408/808] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:25.624755 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aabb2-ba90-43b8-9292-98a411c2558f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:25.663359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251d73f-7ce3-425b-98f5-8ab3aeb9de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:25.663994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d73f-7ce3-425b-98f5-8ab3aeb9de99 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:25.664274 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d73f-7ce3-425b-98f5-8ab3aeb9de99 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:25.664625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251d73f-7ce3-425b-98f5-8ab3aeb9de99 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:25.665351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251d73f-7ce3-425b-98f5-8ab3aeb9de99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:25.665685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251d73f-7ce3-425b-98f5-8ab3aeb9de99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:25.667262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251d73f-7ce3-425b-98f5-8ab3aeb9de99 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:25.685352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 401/809] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:25.687386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:25.798400 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b0d7-19b8-442b-a971-a594d48bea36 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:25.834408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c917c-7c35-4f2d-9764-d4de58c58e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:25.835093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c917c-7c35-4f2d-9764-d4de58c58e43 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:25.835370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c917c-7c35-4f2d-9764-d4de58c58e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:25.835669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c917c-7c35-4f2d-9764-d4de58c58e43 None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/78b5bbfc207243febee44e0d7cacb7b7/roles/b8634c0b048043c88b5008f2ef802b36` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:25.837787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c917c-7c35-4f2d-9764-d4de58c58e43 None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=78b5bbfc207243febee44e0d7cacb7b7, role_id=b8634c0b048043c88b5008f2ef802b36)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:25.839259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c917c-7c35-4f2d-9764-d4de58c58e43 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:25.853932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 409/810] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:47:25 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/78b5bbfc207243febee44e0d7cacb7b7/roles/b8634c0b048043c88b5008f2ef802b36 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:47:26.304008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c676ff-2bd3-4322-8ccb-e67830d3177c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:26.304297 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c676ff-2bd3-4322-8ccb-e67830d3177c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:26.304573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c676ff-2bd3-4322-8ccb-e67830d3177c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:26.306041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 402/811] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:26.311357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572114f-ed25-4679-aad0-4f6e3c489a46 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:26.311640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572114f-ed25-4679-aad0-4f6e3c489a46 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:26.311911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572114f-ed25-4679-aad0-4f6e3c489a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:26.324489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:26.330303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d572114f-ed25-4679-aad0-4f6e3c489a46 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:26.332098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d572114f-ed25-4679-aad0-4f6e3c489a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:26.397450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 410/812] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:47:26.668428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c676ff-2bd3-4322-8ccb-e67830d3177c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:26.769670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c676ff-2bd3-4322-8ccb-e67830d3177c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:26.798638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:26.803978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3c4e-9e39-48d7-b150-eaa4c48e7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:26.804593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3c4e-9e39-48d7-b150-eaa4c48e7b08 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:26.804883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3c4e-9e39-48d7-b150-eaa4c48e7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:26.805138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3c4e-9e39-48d7-b150-eaa4c48e7b08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:26.814877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb3c4e-9e39-48d7-b150-eaa4c48e7b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-87bb3c4e-9e39-48d7-b150-eaa4c48e7b08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:47:26.819573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:26.822661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:26.823750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 403/813] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:26.826880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572114f-ed25-4679-aad0-4f6e3c489a46 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:26.926245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572114f-ed25-4679-aad0-4f6e3c489a46 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:26.966503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:26.967128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:26.967402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:26.967669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:26.968324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:26.968620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:26.969963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:26.972175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:26.978850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 411/814] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:26.985804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3c4e-9e39-48d7-b150-eaa4c48e7b08 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:27.082196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3c4e-9e39-48d7-b150-eaa4c48e7b08 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:27.116422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29c30-c8ed-4152-881d-42e37c28ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:27.117035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29c30-c8ed-4152-881d-42e37c28ee46 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:27.117307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29c30-c8ed-4152-881d-42e37c28ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:27.117571 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29c30-c8ed-4152-881d-42e37c28ee46 None admin] PATH_INFO: `/v3/users/19fddde8c04649faa6cd96fa152bcae8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:27.130433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29c30-c8ed-4152-881d-42e37c28ee46 None admin] RBAC: Authorizing `identity:get_user(user_id=19fddde8c04649faa6cd96fa152bcae8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:27.131898 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29c30-c8ed-4152-881d-42e37c28ee46 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:27.133498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 404/815] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:47:26 2022] GET /identity/v3/users/19fddde8c04649faa6cd96fa152bcae8 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:27.139713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:27.236256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bafa22-f778-4b80-85bb-c93395f89d5c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:27.269222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63323e3-10c5-40eb-a9d7-34eff732ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:27.269840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63323e3-10c5-40eb-a9d7-34eff732ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:27.270116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63323e3-10c5-40eb-a9d7-34eff732ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:27.270388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63323e3-10c5-40eb-a9d7-34eff732ecb9 None admin] PATH_INFO: `/v3/projects/48291d7038f341c5bd44a3858db3c01e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:27.271522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63323e3-10c5-40eb-a9d7-34eff732ecb9 None admin] RBAC: Authorizing `identity:get_project(project_id=48291d7038f341c5bd44a3858db3c01e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:27.272940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63323e3-10c5-40eb-a9d7-34eff732ecb9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:27.274563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 412/816] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:47:27 2022] GET /identity/v3/projects/48291d7038f341c5bd44a3858db3c01e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:27.280962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29c30-c8ed-4152-881d-42e37c28ee46 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:27.329062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:27.378139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29c30-c8ed-4152-881d-42e37c28ee46 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:27.410746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229867ac-6643-4e5f-bd97-a1153bb83328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:27.411393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229867ac-6643-4e5f-bd97-a1153bb83328 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:27.411671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229867ac-6643-4e5f-bd97-a1153bb83328 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:27.411944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229867ac-6643-4e5f-bd97-a1153bb83328 None admin] PATH_INFO: `/v3/projects/48291d7038f341c5bd44a3858db3c01e/users/19fddde8c04649faa6cd96fa152bcae8/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:27.413806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229867ac-6643-4e5f-bd97-a1153bb83328 None admin] RBAC: Authorizing `identity:create_grant(project_id=48291d7038f341c5bd44a3858db3c01e, user_id=19fddde8c04649faa6cd96fa152bcae8, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:27.415259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229867ac-6643-4e5f-bd97-a1153bb83328 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:27.428743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 405/817] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:47:27 2022] PUT /identity/v3/projects/48291d7038f341c5bd44a3858db3c01e/users/19fddde8c04649faa6cd96fa152bcae8/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:47:28.016374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2177de-e21d-4975-a473-ce7e3d31daad None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:28.016912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2177de-e21d-4975-a473-ce7e3d31daad None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:28.016912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2177de-e21d-4975-a473-ce7e3d31daad None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:28.018275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 413/818] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:28.023532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066f38-68be-4bbf-ae12-b1ed1c02ed10 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:28.023968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066f38-68be-4bbf-ae12-b1ed1c02ed10 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:28.024069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066f38-68be-4bbf-ae12-b1ed1c02ed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:28.041738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-22066f38-68be-4bbf-ae12-b1ed1c02ed10 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:28.043006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-22066f38-68be-4bbf-ae12-b1ed1c02ed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:28.107804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 406/819] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:28.378457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2177de-e21d-4975-a473-ce7e3d31daad None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:28.443429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:28.478333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2177de-e21d-4975-a473-ce7e3d31daad None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:28.512310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0ceb-bdc4-4528-8544-154fb811975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:28.512977 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0ceb-bdc4-4528-8544-154fb811975c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:28.513242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0ceb-bdc4-4528-8544-154fb811975c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:28.513513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0ceb-bdc4-4528-8544-154fb811975c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:28.523222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec0ceb-bdc4-4528-8544-154fb811975c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c8ec0ceb-bdc4-4528-8544-154fb811975c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:47:28.527871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:28.530649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:28.531544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 414/820] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Oct 10 16:47:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:28.535439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22066f38-68be-4bbf-ae12-b1ed1c02ed10 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:28.576314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:28.636097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22066f38-68be-4bbf-ae12-b1ed1c02ed10 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:28.670679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:28.671283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:28.671562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:28.671834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:28.672494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:28.672797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:28.674161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:28.681848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 407/821] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Oct 10 16:47:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:28.687718 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0ceb-bdc4-4528-8544-154fb811975c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:28.787586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0ceb-bdc4-4528-8544-154fb811975c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:28.812975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:28.821676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:28.822297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:28.822601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:28.822872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:28.833476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:28.834922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:28.850022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:28.851161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:28.852076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:28.852076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:28.852076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:28.852076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 415/822] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:28.858910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:28.964986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075f228-c0a3-4acb-b1ee-16cf97524f24 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:28.967618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:29.001263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:29.001872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:29.002150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:29.002421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:29.003082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:29.003382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:29.004732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:29.017347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 408/823] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:29.023074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:29.120258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107aa209-f2f8-43a7-b940-7673f909b28a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:29.154639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:29.155199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:29.155478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:29.155749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:29.163055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:29.164492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:47:29.175725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:29.176822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:29.178068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 416/824] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Oct 10 16:47:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:29.182635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:29.279897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f7142-cb9e-45d2-96ae-3d8b696e2150 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:29.313381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13c34-4973-4298-91ba-914c4091e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:29.313969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13c34-4973-4298-91ba-914c4091e3aa None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:29.314244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13c34-4973-4298-91ba-914c4091e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:29.314509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13c34-4973-4298-91ba-914c4091e3aa None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:29.315246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13c34-4973-4298-91ba-914c4091e3aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:29.315543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13c34-4973-4298-91ba-914c4091e3aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:29.316950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13c34-4973-4298-91ba-914c4091e3aa None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:29.334109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 409/825] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Oct 10 16:47:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:29.339884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:29.379278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:29.443110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb2787-9427-4c02-94fc-c09be3bce844 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:29.476248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4f10d-0430-4890-9be9-8964308b616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:29.476908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4f10d-0430-4890-9be9-8964308b616f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:29.477155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4f10d-0430-4890-9be9-8964308b616f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:29.477388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4f10d-0430-4890-9be9-8964308b616f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:29.532681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8a249-c54b-4b2d-8b6d-051e5b1ee3af None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:29.532966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8a249-c54b-4b2d-8b6d-051e5b1ee3af None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:29.533246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8a249-c54b-4b2d-8b6d-051e5b1ee3af None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:29.534613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 410/826] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:47:29.539538 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36ade-ab60-48c7-9b2a-fb7f531760a3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:29.539823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36ade-ab60-48c7-9b2a-fb7f531760a3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:29.540124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36ade-ab60-48c7-9b2a-fb7f531760a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:29.544700 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4f10d-0430-4890-9be9-8964308b616f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:29.546256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4f10d-0430-4890-9be9-8964308b616f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:29.558610 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-19b36ade-ab60-48c7-9b2a-fb7f531760a3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:29.560487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-19b36ade-ab60-48c7-9b2a-fb7f531760a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:29.575903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:29.586300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:29.629186 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 411/827] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:47:29.648018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 417/828] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:47:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 10 16:47:29.653734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b36ade-ab60-48c7-9b2a-fb7f531760a3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:29.749922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b36ade-ab60-48c7-9b2a-fb7f531760a3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:29.783110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:29.783828 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:29.784241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:29.784523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:29.795053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:29.796525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:47:29.810819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:29.811722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:47:29.812653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:47:29.812653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:47:29.812653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:29.812653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 412/829] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:29.817651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4f10d-0430-4890-9be9-8964308b616f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:29.899592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:29.902553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:29.918718 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4f10d-0430-4890-9be9-8964308b616f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:29.952606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:29.953205 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:29.953483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:29.953749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:29.954378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:29.954780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:29.956131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:29.962677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:29.969282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 418/830] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:29.974885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:30.001512 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b482e-0ac2-46f2-acbb-9ba320665e7f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.035145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a4ca0-7573-4029-9795-bfd005afffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.035771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4ca0-7573-4029-9795-bfd005afffce None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.036060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4ca0-7573-4029-9795-bfd005afffce None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.036333 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4ca0-7573-4029-9795-bfd005afffce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.047320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a4ca0-7573-4029-9795-bfd005afffce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-aa1a4ca0-7573-4029-9795-bfd005afffce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:47:30.052161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:30.053071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:30.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 413/831] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:47:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:30.059295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a4ca0-7573-4029-9795-bfd005afffce None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:30.074839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a931376-669d-420b-be08-b50e448c89ad None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.108943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.109566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.109845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.110118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.116747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:30.118177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:30.118920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:47:30.130053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:30.131148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:30.132051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 419/832] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:47:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 16:47:30.137423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:30.158027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a4ca0-7573-4029-9795-bfd005afffce None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.189789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.190372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.190673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.190941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.191594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:30.191887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:30.193266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:30.196611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:30.203281 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 414/833] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:47:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:30.209016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:30.239606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaca8d2-818f-456d-91ec-7ce1da48d901 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.273467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.274002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.274281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.274582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.275275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:30.275576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:30.276998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:30.289441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 420/834] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:30.295989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:30.309046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa712455-2ed1-4107-ab4b-273f0a4e776b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.333292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:30.344359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd0032-ce17-46d8-a409-3ae3b387b869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.344985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd0032-ce17-46d8-a409-3ae3b387b869 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.345269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd0032-ce17-46d8-a409-3ae3b387b869 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.345551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd0032-ce17-46d8-a409-3ae3b387b869 None admin] PATH_INFO: `/v3/users/19fddde8c04649faa6cd96fa152bcae8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.346723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd0032-ce17-46d8-a409-3ae3b387b869 None admin] RBAC: Authorizing `identity:get_user(user_id=19fddde8c04649faa6cd96fa152bcae8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:30.348166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd0032-ce17-46d8-a409-3ae3b387b869 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:30.349754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 415/835] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:47:30 2022] GET /identity/v3/users/19fddde8c04649faa6cd96fa152bcae8 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:30.355339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd0032-ce17-46d8-a409-3ae3b387b869 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:30.397330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3bab0-bd62-4f5a-842c-95c87ea6bf0b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.414685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:30.432434 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.433036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.433312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.433579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.434298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] RBAC: Adding query filter params (role.id=b8634c0b048043c88b5008f2ef802b36, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=78b5bbfc207243febee44e0d7cacb7b7) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:30.434650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:30.436639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:30.442291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 421/836] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:47:30 2022] GET /identity/v3/role_assignments?user.id=78b5bbfc207243febee44e0d7cacb7b7&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=b8634c0b048043c88b5008f2ef802b36 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:30.454857 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd0032-ce17-46d8-a409-3ae3b387b869 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.493719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6b74-e41d-4d70-9f48-9fda7ae3555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.494347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6b74-e41d-4d70-9f48-9fda7ae3555b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.494663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6b74-e41d-4d70-9f48-9fda7ae3555b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.494940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6b74-e41d-4d70-9f48-9fda7ae3555b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.561311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:30.571562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a6b74-e41d-4d70-9f48-9fda7ae3555b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:30.573015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a6b74-e41d-4d70-9f48-9fda7ae3555b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:30.675405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 416/837] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:47:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:47:30.681489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:30.783583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c90db7-6d16-4f92-8c1b-807dba4cbe8a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.819451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c148ae-83c5-4b41-8ede-180799cbbfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.820014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c148ae-83c5-4b41-8ede-180799cbbfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.820292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c148ae-83c5-4b41-8ede-180799cbbfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.820559 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c148ae-83c5-4b41-8ede-180799cbbfe3 None admin] PATH_INFO: `/v3/projects/48291d7038f341c5bd44a3858db3c01e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.821666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c148ae-83c5-4b41-8ede-180799cbbfe3 None admin] RBAC: Authorizing `identity:get_project(project_id=48291d7038f341c5bd44a3858db3c01e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:30.823121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c148ae-83c5-4b41-8ede-180799cbbfe3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:30.824735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 422/838] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:47:30 2022] GET /identity/v3/projects/48291d7038f341c5bd44a3858db3c01e => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:30.831166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6b74-e41d-4d70-9f48-9fda7ae3555b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:30.925438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:30.937881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6b74-e41d-4d70-9f48-9fda7ae3555b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:30.976212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9047b2d-d674-43d4-8351-5a16abfed521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:30.976818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b2d-d674-43d4-8351-5a16abfed521 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:30.977105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b2d-d674-43d4-8351-5a16abfed521 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:30.977357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b2d-d674-43d4-8351-5a16abfed521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:30.978079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047b2d-d674-43d4-8351-5a16abfed521 None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=48291d7038f341c5bd44a3858db3c01e, user.id=19fddde8c04649faa6cd96fa152bcae8) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:30.978386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047b2d-d674-43d4-8351-5a16abfed521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:30.979882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047b2d-d674-43d4-8351-5a16abfed521 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:30.986420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 417/839] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:47:30 2022] GET /identity/v3/role_assignments?user.id=19fddde8c04649faa6cd96fa152bcae8&scope.project.id=48291d7038f341c5bd44a3858db3c01e&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:33.128921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d91c28-bc58-4a93-9e16-608d485bd0a3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:33.129454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d91c28-bc58-4a93-9e16-608d485bd0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:33.129454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d91c28-bc58-4a93-9e16-608d485bd0a3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:33.130821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 423/840] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:33.136022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4c31e-fcbb-448a-abc7-7d1cbbef7cfe None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:33.136428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4c31e-fcbb-448a-abc7-7d1cbbef7cfe None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:33.136579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4c31e-fcbb-448a-abc7-7d1cbbef7cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:33.155177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c4e4c31e-fcbb-448a-abc7-7d1cbbef7cfe None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:33.156300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c4e4c31e-fcbb-448a-abc7-7d1cbbef7cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:33.221286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 418/841] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:33.492898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d91c28-bc58-4a93-9e16-608d485bd0a3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:33.543600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:33.593133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d91c28-bc58-4a93-9e16-608d485bd0a3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:33.627300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a854e1-1d8a-480a-bec0-84a1e63cd417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:33.627907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a854e1-1d8a-480a-bec0-84a1e63cd417 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:33.628182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a854e1-1d8a-480a-bec0-84a1e63cd417 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:33.628453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a854e1-1d8a-480a-bec0-84a1e63cd417 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:33.629556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a854e1-1d8a-480a-bec0-84a1e63cd417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:33.630995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a854e1-1d8a-480a-bec0-84a1e63cd417 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:33.632534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 424/842] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:33.638942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4c31e-fcbb-448a-abc7-7d1cbbef7cfe None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:33.720588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:33.735335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4c31e-fcbb-448a-abc7-7d1cbbef7cfe None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:33.881615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2132a0-d79f-4bdf-9484-f1817344184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:33.882131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2132a0-d79f-4bdf-9484-f1817344184f None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:33.882404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2132a0-d79f-4bdf-9484-f1817344184f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:33.882705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2132a0-d79f-4bdf-9484-f1817344184f None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:33.883356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2132a0-d79f-4bdf-9484-f1817344184f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:33.885035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2132a0-d79f-4bdf-9484-f1817344184f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:33.906276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 419/843] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:47:33 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:36.064449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509609f4-00cc-49ed-94ac-a84c9cd3488a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:36.064972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509609f4-00cc-49ed-94ac-a84c9cd3488a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:36.065084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509609f4-00cc-49ed-94ac-a84c9cd3488a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:36.066338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 425/844] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:36.071582 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29362-023d-44f0-8083-5be421de58dc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:36.071990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29362-023d-44f0-8083-5be421de58dc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:36.072133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29362-023d-44f0-8083-5be421de58dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:36.090131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ada29362-023d-44f0-8083-5be421de58dc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:36.092216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ada29362-023d-44f0-8083-5be421de58dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:36.157207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 420/845] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:36.428697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509609f4-00cc-49ed-94ac-a84c9cd3488a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:36.531304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509609f4-00cc-49ed-94ac-a84c9cd3488a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:36.548481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:36.565094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3e4d-637f-4720-a15e-f359b52e5c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:36.565717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3e4d-637f-4720-a15e-f359b52e5c0c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:36.565998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3e4d-637f-4720-a15e-f359b52e5c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:36.566273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3e4d-637f-4720-a15e-f359b52e5c0c None admin] PATH_INFO: `/v3/roles/916b82353e034dbd9ae74f32d945ac09` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:36.567684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3e4d-637f-4720-a15e-f359b52e5c0c None admin] RBAC: Authorizing `identity:get_role(role_id=916b82353e034dbd9ae74f32d945ac09)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:36.569042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3e4d-637f-4720-a15e-f359b52e5c0c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:36.570349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 426/846] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:47:36 2022] GET /identity/v3/roles/916b82353e034dbd9ae74f32d945ac09 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:36.576620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada29362-023d-44f0-8083-5be421de58dc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:36.649245 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:36.679679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada29362-023d-44f0-8083-5be421de58dc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:36.711602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349c7ca-07cb-4bcb-8582-a678892884e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:36.712296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349c7ca-07cb-4bcb-8582-a678892884e5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:36.712575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349c7ca-07cb-4bcb-8582-a678892884e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:36.712843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349c7ca-07cb-4bcb-8582-a678892884e5 None admin] PATH_INFO: `/v3/users/0f445b4514fd43429de2c377432c7ab1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:36.725616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349c7ca-07cb-4bcb-8582-a678892884e5 None admin] RBAC: Authorizing `identity:get_user(user_id=0f445b4514fd43429de2c377432c7ab1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:36.727069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349c7ca-07cb-4bcb-8582-a678892884e5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:36.728647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 421/847] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:47:36 2022] GET /identity/v3/users/0f445b4514fd43429de2c377432c7ab1 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:36.735226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3e4d-637f-4720-a15e-f359b52e5c0c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:36.831126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3e4d-637f-4720-a15e-f359b52e5c0c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:36.864585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95558-3976-42bb-a861-3859bfcaa37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:36.865180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95558-3976-42bb-a861-3859bfcaa37a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:36.865459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95558-3976-42bb-a861-3859bfcaa37a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:36.865732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95558-3976-42bb-a861-3859bfcaa37a None admin] PATH_INFO: `/v3/projects/48291d7038f341c5bd44a3858db3c01e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:36.866872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95558-3976-42bb-a861-3859bfcaa37a None admin] RBAC: Authorizing `identity:get_project(project_id=48291d7038f341c5bd44a3858db3c01e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:36.868282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95558-3976-42bb-a861-3859bfcaa37a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:36.869880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 427/848] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:47:36 2022] GET /identity/v3/projects/48291d7038f341c5bd44a3858db3c01e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:36.875787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349c7ca-07cb-4bcb-8582-a678892884e5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:36.974947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349c7ca-07cb-4bcb-8582-a678892884e5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:37.002473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:37.008807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53231-665b-4538-82de-af1a9cdb3473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:37.009462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53231-665b-4538-82de-af1a9cdb3473 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:37.009742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53231-665b-4538-82de-af1a9cdb3473 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:37.010017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53231-665b-4538-82de-af1a9cdb3473 None admin] PATH_INFO: `/v3/projects/48291d7038f341c5bd44a3858db3c01e/users/0f445b4514fd43429de2c377432c7ab1/roles/916b82353e034dbd9ae74f32d945ac09` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:37.012138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a53231-665b-4538-82de-af1a9cdb3473 None admin] RBAC: Authorizing `identity:create_grant(project_id=48291d7038f341c5bd44a3858db3c01e, user_id=0f445b4514fd43429de2c377432c7ab1, role_id=916b82353e034dbd9ae74f32d945ac09)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:37.014154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a53231-665b-4538-82de-af1a9cdb3473 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:37.025862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 422/849] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:47:36 2022] PUT /identity/v3/projects/48291d7038f341c5bd44a3858db3c01e/users/0f445b4514fd43429de2c377432c7ab1/roles/916b82353e034dbd9ae74f32d945ac09 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:47:39.129906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd4b7-516c-41a3-8718-e050f9dcfb44 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:39.130458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd4b7-516c-41a3-8718-e050f9dcfb44 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:39.130458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd4b7-516c-41a3-8718-e050f9dcfb44 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:39.131954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 428/850] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:39.137059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e79722-4755-4f19-b647-568aaf7db4ba None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:39.137503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e79722-4755-4f19-b647-568aaf7db4ba None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:39.137600 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e79722-4755-4f19-b647-568aaf7db4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:39.156048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e6e79722-4755-4f19-b647-568aaf7db4ba None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:39.157164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e6e79722-4755-4f19-b647-568aaf7db4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:39.222284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 423/851] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:39.490357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd4b7-516c-41a3-8718-e050f9dcfb44 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:39.546502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:39.590040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd4b7-516c-41a3-8718-e050f9dcfb44 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:39.623160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce6855-3e06-4be1-9b8e-a37cec0f5627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:39.623769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6855-3e06-4be1-9b8e-a37cec0f5627 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:39.624043 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6855-3e06-4be1-9b8e-a37cec0f5627 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:39.624312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6855-3e06-4be1-9b8e-a37cec0f5627 None admin] PATH_INFO: `/v3/roles/916b82353e034dbd9ae74f32d945ac09` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:39.625664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce6855-3e06-4be1-9b8e-a37cec0f5627 None admin] RBAC: Authorizing `identity:get_role(role_id=916b82353e034dbd9ae74f32d945ac09)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:39.627288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce6855-3e06-4be1-9b8e-a37cec0f5627 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:39.628579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 429/852] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:47:39 2022] GET /identity/v3/roles/916b82353e034dbd9ae74f32d945ac09 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:39.634292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e79722-4755-4f19-b647-568aaf7db4ba None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:39.730465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e79722-4755-4f19-b647-568aaf7db4ba None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:39.750580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:39.765035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77c5b9-4b06-44d0-b097-89c7b5974de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:39.765656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77c5b9-4b06-44d0-b097-89c7b5974de6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:39.765935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77c5b9-4b06-44d0-b097-89c7b5974de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:39.766208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77c5b9-4b06-44d0-b097-89c7b5974de6 None admin] PATH_INFO: `/v3/users/0f445b4514fd43429de2c377432c7ab1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:39.767353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77c5b9-4b06-44d0-b097-89c7b5974de6 None admin] RBAC: Authorizing `identity:get_user(user_id=0f445b4514fd43429de2c377432c7ab1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:39.768771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77c5b9-4b06-44d0-b097-89c7b5974de6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:39.770331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 424/853] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:47:39 2022] GET /identity/v3/users/0f445b4514fd43429de2c377432c7ab1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:39.775961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce6855-3e06-4be1-9b8e-a37cec0f5627 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:39.871323 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce6855-3e06-4be1-9b8e-a37cec0f5627 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:39.894695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:39.907155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88ceb-1bb7-4646-aa18-ccf2ba238ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:39.907750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88ceb-1bb7-4646-aa18-ccf2ba238ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:39.908022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88ceb-1bb7-4646-aa18-ccf2ba238ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:39.908289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88ceb-1bb7-4646-aa18-ccf2ba238ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:39.973000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88ceb-1bb7-4646-aa18-ccf2ba238ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:39.974426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88ceb-1bb7-4646-aa18-ccf2ba238ce0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:40.068230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 430/854] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:47:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:47:40.074023 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77c5b9-4b06-44d0-b097-89c7b5974de6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:40.168275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77c5b9-4b06-44d0-b097-89c7b5974de6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:40.199660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53098b14-87fc-4217-9174-acc724fe728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:40.200267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53098b14-87fc-4217-9174-acc724fe728f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:40.200539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53098b14-87fc-4217-9174-acc724fe728f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:40.200807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53098b14-87fc-4217-9174-acc724fe728f None admin] PATH_INFO: `/v3/projects/48291d7038f341c5bd44a3858db3c01e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:40.202426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53098b14-87fc-4217-9174-acc724fe728f None admin] RBAC: Authorizing `identity:get_project(project_id=48291d7038f341c5bd44a3858db3c01e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:40.203855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53098b14-87fc-4217-9174-acc724fe728f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:40.205419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 425/855] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:47:40 2022] GET /identity/v3/projects/48291d7038f341c5bd44a3858db3c01e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:40.211537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88ceb-1bb7-4646-aa18-ccf2ba238ce0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:40.234803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:40.307493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88ceb-1bb7-4646-aa18-ccf2ba238ce0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:40.340249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fd753-4e50-4c54-91f4-c0e4b8062973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:40.340772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd753-4e50-4c54-91f4-c0e4b8062973 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:40.341047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd753-4e50-4c54-91f4-c0e4b8062973 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:40.341320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd753-4e50-4c54-91f4-c0e4b8062973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:40.342591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fd753-4e50-4c54-91f4-c0e4b8062973 None admin] RBAC: Adding query filter params (role.id=916b82353e034dbd9ae74f32d945ac09, scope.project.id=48291d7038f341c5bd44a3858db3c01e, user.id=0f445b4514fd43429de2c377432c7ab1) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:40.342900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fd753-4e50-4c54-91f4-c0e4b8062973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:40.344298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fd753-4e50-4c54-91f4-c0e4b8062973 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:40.349849 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 431/856] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:47:40 2022] GET /identity/v3/role_assignments?user.id=0f445b4514fd43429de2c377432c7ab1&scope.project.id=48291d7038f341c5bd44a3858db3c01e&role.id=916b82353e034dbd9ae74f32d945ac09 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:42.472224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b928d4-f275-47d9-8ef9-e38cc424342e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:42.472805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b928d4-f275-47d9-8ef9-e38cc424342e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:42.472805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b928d4-f275-47d9-8ef9-e38cc424342e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:42.474084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 426/857] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:42.479591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3cf9d-f95b-4687-81d7-b537d8bd1ce9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:42.479999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3cf9d-f95b-4687-81d7-b537d8bd1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:42.480171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3cf9d-f95b-4687-81d7-b537d8bd1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:42.498968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5de3cf9d-f95b-4687-81d7-b537d8bd1ce9 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:42.500150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5de3cf9d-f95b-4687-81d7-b537d8bd1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:42.563718 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 432/858] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:42.829527 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b928d4-f275-47d9-8ef9-e38cc424342e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:42.885070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:42.928601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b928d4-f275-47d9-8ef9-e38cc424342e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:42.960777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ddff2-9dd7-40ed-ae81-4e8adcb5de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:42.961396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ddff2-9dd7-40ed-ae81-4e8adcb5de79 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:42.961668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ddff2-9dd7-40ed-ae81-4e8adcb5de79 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:42.961935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ddff2-9dd7-40ed-ae81-4e8adcb5de79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:42.963038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ddff2-9dd7-40ed-ae81-4e8adcb5de79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:42.964456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ddff2-9dd7-40ed-ae81-4e8adcb5de79 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:42.965988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 427/859] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:42.972006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3cf9d-f95b-4687-81d7-b537d8bd1ce9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:42.990299 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:43.071898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3cf9d-f95b-4687-81d7-b537d8bd1ce9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:43.104387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f07d3-6f98-419f-9d49-58aa68d181c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:43.104938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f07d3-6f98-419f-9d49-58aa68d181c9 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:43.105220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f07d3-6f98-419f-9d49-58aa68d181c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:43.105496 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f07d3-6f98-419f-9d49-58aa68d181c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:43.106148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f07d3-6f98-419f-9d49-58aa68d181c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:43.108110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f07d3-6f98-419f-9d49-58aa68d181c9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:43.134803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 433/860] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:47:42 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:45.300937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d0b6-2484-413d-8437-95b37d9b324a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:45.301458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d0b6-2484-413d-8437-95b37d9b324a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:45.301458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d0b6-2484-413d-8437-95b37d9b324a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:45.302778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 428/861] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:45.307987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4818f-065c-498a-86c4-58903f90db82 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:45.308365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4818f-065c-498a-86c4-58903f90db82 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:45.308537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4818f-065c-498a-86c4-58903f90db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:45.327002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-aab4818f-065c-498a-86c4-58903f90db82 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:45.328177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aab4818f-065c-498a-86c4-58903f90db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:45.387376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:45.394122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 434/862] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:45.659878 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4d0b6-2484-413d-8437-95b37d9b324a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:45.758433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4d0b6-2484-413d-8437-95b37d9b324a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:45.780964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:45.791482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cb5ec-5a94-467a-b45b-e7ba762f4467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:45.792091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cb5ec-5a94-467a-b45b-e7ba762f4467 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:45.792367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cb5ec-5a94-467a-b45b-e7ba762f4467 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:45.792639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cb5ec-5a94-467a-b45b-e7ba762f4467 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:45.793726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cb5ec-5a94-467a-b45b-e7ba762f4467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:45.795780 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cb5ec-5a94-467a-b45b-e7ba762f4467 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:45.797299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 429/863] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:47:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:45.803078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4818f-065c-498a-86c4-58903f90db82 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:45.898190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4818f-065c-498a-86c4-58903f90db82 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:45.930989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dac40-01cf-43db-8297-7faaef6027cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:45.931524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dac40-01cf-43db-8297-7faaef6027cf None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:45.931796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dac40-01cf-43db-8297-7faaef6027cf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:45.932061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dac40-01cf-43db-8297-7faaef6027cf None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:45.932715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dac40-01cf-43db-8297-7faaef6027cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:45.934115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dac40-01cf-43db-8297-7faaef6027cf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:45.954818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 435/864] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:47:45 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:47:48.092851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb4555-3b26-4a13-a644-9ed135256b33 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:48.093413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb4555-3b26-4a13-a644-9ed135256b33 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:48.093413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb4555-3b26-4a13-a644-9ed135256b33 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:48.094723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 430/865] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:48.099852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72077b4e-fe4d-470f-8ab5-c793833aeef0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:48.100293 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72077b4e-fe4d-470f-8ab5-c793833aeef0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:48.100392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72077b4e-fe4d-470f-8ab5-c793833aeef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:48.119239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-72077b4e-fe4d-470f-8ab5-c793833aeef0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:48.120416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-72077b4e-fe4d-470f-8ab5-c793833aeef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:48.169533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:48.187259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 436/866] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:48.458003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb4555-3b26-4a13-a644-9ed135256b33 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:48.557140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb4555-3b26-4a13-a644-9ed135256b33 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:48.589174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978bbb3-7e50-4330-a578-841ebe0d2787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:48.589792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978bbb3-7e50-4330-a578-841ebe0d2787 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:48.590072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978bbb3-7e50-4330-a578-841ebe0d2787 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:48.590343 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978bbb3-7e50-4330-a578-841ebe0d2787 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:48.600678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978bbb3-7e50-4330-a578-841ebe0d2787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-c978bbb3-7e50-4330-a578-841ebe0d2787 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:47:48.605434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:48.606616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:47:48.608545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 431/867] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:47:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:48.613143 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72077b4e-fe4d-470f-8ab5-c793833aeef0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:48.707522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72077b4e-fe4d-470f-8ab5-c793833aeef0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:48.740501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:48.741040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:48.741315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:48.741580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:48.742225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:48.742555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:48.743889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:48.751959 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 437/868] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:47:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:47:48.758132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978bbb3-7e50-4330-a578-841ebe0d2787 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:48.809300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:48.854492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978bbb3-7e50-4330-a578-841ebe0d2787 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:48.888681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf894ef-2a31-461a-b407-3f9e4637b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:48.889431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf894ef-2a31-461a-b407-3f9e4637b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:48.889712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf894ef-2a31-461a-b407-3f9e4637b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:48.889991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf894ef-2a31-461a-b407-3f9e4637b9c3 None admin] PATH_INFO: `/v3/users/0e12a5d691f24c109479a36409ed1cf9` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:48.903589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf894ef-2a31-461a-b407-3f9e4637b9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=0e12a5d691f24c109479a36409ed1cf9)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:48.905641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf894ef-2a31-461a-b407-3f9e4637b9c3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:48.907268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 432/869] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:47:48 2022] GET /identity/v3/users/0e12a5d691f24c109479a36409ed1cf9 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:48.913026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:48.958091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:49.010188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac962def-601a-43e3-b1b3-f71d8cfd3e94 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:49.044343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12722930-40e5-4e24-bb99-0ced2f17f0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:49.045070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722930-40e5-4e24-bb99-0ced2f17f0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:49.045345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722930-40e5-4e24-bb99-0ced2f17f0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:49.045615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722930-40e5-4e24-bb99-0ced2f17f0c7 None admin] PATH_INFO: `/v3/projects/6bbf909543574a4197465e1658c6346d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:49.046739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12722930-40e5-4e24-bb99-0ced2f17f0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=6bbf909543574a4197465e1658c6346d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:49.048152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12722930-40e5-4e24-bb99-0ced2f17f0c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:49.049760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 438/870] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:47:48 2022] GET /identity/v3/projects/6bbf909543574a4197465e1658c6346d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:49.055716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf894ef-2a31-461a-b407-3f9e4637b9c3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:49.150969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf894ef-2a31-461a-b407-3f9e4637b9c3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:49.161871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:49.184311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02cede-2652-4de0-bd20-10ab8f8f14a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:49.184952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02cede-2652-4de0-bd20-10ab8f8f14a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:49.185284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02cede-2652-4de0-bd20-10ab8f8f14a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:49.185681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02cede-2652-4de0-bd20-10ab8f8f14a3 None admin] PATH_INFO: `/v3/projects/6bbf909543574a4197465e1658c6346d/users/0e12a5d691f24c109479a36409ed1cf9/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:49.187439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02cede-2652-4de0-bd20-10ab8f8f14a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bbf909543574a4197465e1658c6346d, user_id=0e12a5d691f24c109479a36409ed1cf9, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:49.188856 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02cede-2652-4de0-bd20-10ab8f8f14a3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:49.202095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 433/871] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:47:49 2022] PUT /identity/v3/projects/6bbf909543574a4197465e1658c6346d/users/0e12a5d691f24c109479a36409ed1cf9/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:47:51.280188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a58b2-4c73-44c7-8a9d-7c02a3277090 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:51.280714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a58b2-4c73-44c7-8a9d-7c02a3277090 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:51.280714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a58b2-4c73-44c7-8a9d-7c02a3277090 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:51.281978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 439/872] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:51.287301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed654f-6249-4194-b684-a73e738a446c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:51.287740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed654f-6249-4194-b684-a73e738a446c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:51.287839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed654f-6249-4194-b684-a73e738a446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:51.305426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-31ed654f-6249-4194-b684-a73e738a446c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:51.306634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-31ed654f-6249-4194-b684-a73e738a446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:51.370970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 434/873] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:51.641153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a58b2-4c73-44c7-8a9d-7c02a3277090 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:51.741742 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a58b2-4c73-44c7-8a9d-7c02a3277090 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:51.756474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:51.776048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79181d0b-2e89-4802-abf9-b20a4e71c234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:51.776665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181d0b-2e89-4802-abf9-b20a4e71c234 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:51.776947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181d0b-2e89-4802-abf9-b20a4e71c234 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:51.777219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181d0b-2e89-4802-abf9-b20a4e71c234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:51.787524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79181d0b-2e89-4802-abf9-b20a4e71c234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-79181d0b-2e89-4802-abf9-b20a4e71c234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:47:51.792297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:47:51.793398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:47:51.795202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 440/874] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:47:51.799806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed654f-6249-4194-b684-a73e738a446c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:51.894544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:51.897713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed654f-6249-4194-b684-a73e738a446c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:51.931987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:51.932574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:51.932847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:51.933115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:51.933762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:51.934059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:51.935446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:51.943071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 435/875] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:47:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:51.948921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79181d0b-2e89-4802-abf9-b20a4e71c234 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:52.047554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79181d0b-2e89-4802-abf9-b20a4e71c234 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:52.079832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fffbc5-d693-4a8c-ac34-1d6a9ca88e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:52.080442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fffbc5-d693-4a8c-ac34-1d6a9ca88e0b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:52.080718 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fffbc5-d693-4a8c-ac34-1d6a9ca88e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:52.080982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fffbc5-d693-4a8c-ac34-1d6a9ca88e0b None admin] PATH_INFO: `/v3/users/0e12a5d691f24c109479a36409ed1cf9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:52.082073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fffbc5-d693-4a8c-ac34-1d6a9ca88e0b None admin] RBAC: Authorizing `identity:get_user(user_id=0e12a5d691f24c109479a36409ed1cf9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:52.083499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fffbc5-d693-4a8c-ac34-1d6a9ca88e0b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:52.085039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 441/876] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:47:51 2022] GET /identity/v3/users/0e12a5d691f24c109479a36409ed1cf9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:52.090733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:52.186194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc0d63-02c9-4766-9fe8-9f63c66fc848 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:52.218388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84c63-775b-4e3a-9070-a6bef21a4ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:52.218998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84c63-775b-4e3a-9070-a6bef21a4ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:52.219273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84c63-775b-4e3a-9070-a6bef21a4ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:52.219539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84c63-775b-4e3a-9070-a6bef21a4ed5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:52.246960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:52.284085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84c63-775b-4e3a-9070-a6bef21a4ed5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:52.285507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84c63-775b-4e3a-9070-a6bef21a4ed5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:52.378394 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 436/877] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:47:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:47:52.384288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fffbc5-d693-4a8c-ac34-1d6a9ca88e0b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:52.426345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:52.480633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fffbc5-d693-4a8c-ac34-1d6a9ca88e0b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:52.513777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee10ca9-06da-4f70-a91a-0b0fc9a6a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:52.514325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee10ca9-06da-4f70-a91a-0b0fc9a6a888 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:52.514625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee10ca9-06da-4f70-a91a-0b0fc9a6a888 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:52.514895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee10ca9-06da-4f70-a91a-0b0fc9a6a888 None admin] PATH_INFO: `/v3/projects/6bbf909543574a4197465e1658c6346d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:52.515990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee10ca9-06da-4f70-a91a-0b0fc9a6a888 None admin] RBAC: Authorizing `identity:get_project(project_id=6bbf909543574a4197465e1658c6346d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:52.517392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee10ca9-06da-4f70-a91a-0b0fc9a6a888 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:52.519004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 442/878] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:47:52 2022] GET /identity/v3/projects/6bbf909543574a4197465e1658c6346d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:52.524937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84c63-775b-4e3a-9070-a6bef21a4ed5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:52.583492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:52.620232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84c63-775b-4e3a-9070-a6bef21a4ed5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:52.652739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b429289-2805-4bdb-b2a1-bbe2f1e53aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:52.653319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b429289-2805-4bdb-b2a1-bbe2f1e53aea None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:52.653592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b429289-2805-4bdb-b2a1-bbe2f1e53aea None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:52.654154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b429289-2805-4bdb-b2a1-bbe2f1e53aea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:52.654895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b429289-2805-4bdb-b2a1-bbe2f1e53aea None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=6bbf909543574a4197465e1658c6346d, user.id=0e12a5d691f24c109479a36409ed1cf9) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:47:52.655197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b429289-2805-4bdb-b2a1-bbe2f1e53aea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:52.656592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b429289-2805-4bdb-b2a1-bbe2f1e53aea None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:52.662036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 437/879] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:47:52 2022] GET /identity/v3/role_assignments?user.id=0e12a5d691f24c109479a36409ed1cf9&scope.project.id=6bbf909543574a4197465e1658c6346d&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:54.810942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9bf9-a3ef-4ba7-a123-62b7d7e262a4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:54.811473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9bf9-a3ef-4ba7-a123-62b7d7e262a4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:54.811473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9bf9-a3ef-4ba7-a123-62b7d7e262a4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:54.812828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 443/880] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:54.817885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7639-d564-4eb4-808a-0c7f98209c9b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:54.818302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7639-d564-4eb4-808a-0c7f98209c9b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:54.818422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7639-d564-4eb4-808a-0c7f98209c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:54.836599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e25c7639-d564-4eb4-808a-0c7f98209c9b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:54.837758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e25c7639-d564-4eb4-808a-0c7f98209c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:54.901551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 438/881] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:55.170644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb9bf9-a3ef-4ba7-a123-62b7d7e262a4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:55.270605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb9bf9-a3ef-4ba7-a123-62b7d7e262a4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:55.280909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:55.304598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ea1dd-8320-458c-9156-fc85f85f10e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:55.305192 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea1dd-8320-458c-9156-fc85f85f10e4 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:55.305474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea1dd-8320-458c-9156-fc85f85f10e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:55.305748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea1dd-8320-458c-9156-fc85f85f10e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:55.306414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ea1dd-8320-458c-9156-fc85f85f10e4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:55.307814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ea1dd-8320-458c-9156-fc85f85f10e4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:55.323252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 444/882] 10.222.0.27 () {60 vars in 1138 bytes} [Mon Oct 10 16:47:55 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:47:57.468191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290819e-1787-4053-9dce-17c34735d609 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:57.468762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290819e-1787-4053-9dce-17c34735d609 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:57.468762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290819e-1787-4053-9dce-17c34735d609 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:57.470057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 439/883] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:47:57.475206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f702ee-6a93-49a9-987d-ae2c1fd366f3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:57.475629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f702ee-6a93-49a9-987d-ae2c1fd366f3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:57.475755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f702ee-6a93-49a9-987d-ae2c1fd366f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:57.494095 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b8f702ee-6a93-49a9-987d-ae2c1fd366f3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:47:57.495310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b8f702ee-6a93-49a9-987d-ae2c1fd366f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:47:57.559970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 445/884] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:47:57.827513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290819e-1787-4053-9dce-17c34735d609 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:57.882754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:57.927129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290819e-1787-4053-9dce-17c34735d609 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:57.960120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972c7e5-8034-4f8a-adc6-5144a9a971c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:57.960733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972c7e5-8034-4f8a-adc6-5144a9a971c3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:57.961010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972c7e5-8034-4f8a-adc6-5144a9a971c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:57.961280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972c7e5-8034-4f8a-adc6-5144a9a971c3 None admin] PATH_INFO: `/v3/domains/ae0cfec7f2e54b7ba3319c61f6ae5e74` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:57.972317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972c7e5-8034-4f8a-adc6-5144a9a971c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae0cfec7f2e54b7ba3319c61f6ae5e74)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:57.973749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972c7e5-8034-4f8a-adc6-5144a9a971c3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:57.975335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 440/885] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Oct 10 16:47:57 2022] GET /identity/v3/domains/ae0cfec7f2e54b7ba3319c61f6ae5e74 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:47:57.981176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f702ee-6a93-49a9-987d-ae2c1fd366f3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:47:58.077448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:47:58.080464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f702ee-6a93-49a9-987d-ae2c1fd366f3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:47:58.115558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fdc13-7999-4879-b07f-984810dc5da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:47:58.116152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fdc13-7999-4879-b07f-984810dc5da4 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:47:58.116433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fdc13-7999-4879-b07f-984810dc5da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:47:58.116707 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fdc13-7999-4879-b07f-984810dc5da4 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:47:58.117357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fdc13-7999-4879-b07f-984810dc5da4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:47:58.118798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fdc13-7999-4879-b07f-984810dc5da4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:47:58.145903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 446/886] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:47:57 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:48:00.304482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241164f0-1b5b-4d53-849f-f2cf5fa1de7a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:00.304995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241164f0-1b5b-4d53-849f-f2cf5fa1de7a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:00.304995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241164f0-1b5b-4d53-849f-f2cf5fa1de7a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:00.306285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 441/887] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:48:00.311477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea907-b134-4972-b7b3-d60bbad82071 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:00.311864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea907-b134-4972-b7b3-d60bbad82071 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:00.312036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea907-b134-4972-b7b3-d60bbad82071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:00.330394 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-793ea907-b134-4972-b7b3-d60bbad82071 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:48:00.331611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-793ea907-b134-4972-b7b3-d60bbad82071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:48:00.395449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 447/888] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:48:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:48:00.664561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241164f0-1b5b-4d53-849f-f2cf5fa1de7a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:00.763130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241164f0-1b5b-4d53-849f-f2cf5fa1de7a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:00.778151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:00.797402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a1543-bc46-4fb9-ab57-e4d019194122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:00.798022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1543-bc46-4fb9-ab57-e4d019194122 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:00.798301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1543-bc46-4fb9-ab57-e4d019194122 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:00.798604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1543-bc46-4fb9-ab57-e4d019194122 None admin] PATH_INFO: `/v3/domains/ae0cfec7f2e54b7ba3319c61f6ae5e74` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:00.799715 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a1543-bc46-4fb9-ab57-e4d019194122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae0cfec7f2e54b7ba3319c61f6ae5e74)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:00.801125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a1543-bc46-4fb9-ab57-e4d019194122 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:00.802695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 442/889] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Oct 10 16:48:00 2022] GET /identity/v3/domains/ae0cfec7f2e54b7ba3319c61f6ae5e74 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:48:00.808357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ea907-b134-4972-b7b3-d60bbad82071 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:00.888211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:00.908275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ea907-b134-4972-b7b3-d60bbad82071 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:00.941102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af564bd-3d51-49a5-947d-24a3c84e0216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:00.941645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af564bd-3d51-49a5-947d-24a3c84e0216 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:00.941926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af564bd-3d51-49a5-947d-24a3c84e0216 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:00.942200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af564bd-3d51-49a5-947d-24a3c84e0216 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:00.942892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af564bd-3d51-49a5-947d-24a3c84e0216 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:00.944316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af564bd-3d51-49a5-947d-24a3c84e0216 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:00.965052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 448/890] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:48:00 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:48:03.109169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031a8aa-3b52-4ca3-8a15-a24ce9a4e2f6 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:03.109695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031a8aa-3b52-4ca3-8a15-a24ce9a4e2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:03.109695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031a8aa-3b52-4ca3-8a15-a24ce9a4e2f6 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:03.111075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 443/891] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:48:03.116091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c133d-e8b7-4558-b9ca-65f2dfff3659 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:03.116486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c133d-e8b7-4558-b9ca-65f2dfff3659 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:03.116639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c133d-e8b7-4558-b9ca-65f2dfff3659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:03.135180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b09c133d-e8b7-4558-b9ca-65f2dfff3659 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:48:03.136343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b09c133d-e8b7-4558-b9ca-65f2dfff3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:48:03.200382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 449/892] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:48:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:48:03.466896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031a8aa-3b52-4ca3-8a15-a24ce9a4e2f6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:03.565916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031a8aa-3b52-4ca3-8a15-a24ce9a4e2f6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:03.597697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e6776-af57-48e1-b52a-52dc689de5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:03.598304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6776-af57-48e1-b52a-52dc689de5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:03.598610 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6776-af57-48e1-b52a-52dc689de5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:03.598880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6776-af57-48e1-b52a-52dc689de5f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:03.609541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e6776-af57-48e1-b52a-52dc689de5f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6c6e6776-af57-48e1-b52a-52dc689de5f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:48:03.614173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:48:03.615363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:48:03.616603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 444/893] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:48:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:48:03.621273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c133d-e8b7-4558-b9ca-65f2dfff3659 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:03.685848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:03.719574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c133d-e8b7-4558-b9ca-65f2dfff3659 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:03.752721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:03.753315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:03.753595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:03.753868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:03.754550 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:48:03.754853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:03.756232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:03.764684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 450/894] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:48:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:48:03.770394 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e6776-af57-48e1-b52a-52dc689de5f7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:03.813932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:03.868006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e6776-af57-48e1-b52a-52dc689de5f7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:03.900823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c0c5-7f8a-4c5f-b734-e37ede0c1e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:03.901445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c0c5-7f8a-4c5f-b734-e37ede0c1e1b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:03.901721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c0c5-7f8a-4c5f-b734-e37ede0c1e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:03.901991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c0c5-7f8a-4c5f-b734-e37ede0c1e1b None admin] PATH_INFO: `/v3/users/eecb3e71d5384f52add154cf69fd22a6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:03.914671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1c0c5-7f8a-4c5f-b734-e37ede0c1e1b None admin] RBAC: Authorizing `identity:get_user(user_id=eecb3e71d5384f52add154cf69fd22a6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:03.916099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1c0c5-7f8a-4c5f-b734-e37ede0c1e1b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:03.917672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 445/895] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:48:03 2022] GET /identity/v3/users/eecb3e71d5384f52add154cf69fd22a6 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:48:03.924232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:04.019367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048797-0234-4848-b1c7-2209139928a5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:04.046633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:04.052787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d995fce-d8af-4a2d-bb25-00a955ce54ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:04.053401 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d995fce-d8af-4a2d-bb25-00a955ce54ad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:04.053675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d995fce-d8af-4a2d-bb25-00a955ce54ad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:04.053942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d995fce-d8af-4a2d-bb25-00a955ce54ad None admin] PATH_INFO: `/v3/projects/f165e15e91ca4525ad7bac94224b29f2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:04.055062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d995fce-d8af-4a2d-bb25-00a955ce54ad None admin] RBAC: Authorizing `identity:get_project(project_id=f165e15e91ca4525ad7bac94224b29f2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:04.056468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d995fce-d8af-4a2d-bb25-00a955ce54ad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:04.058048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 451/896] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:48:03 2022] GET /identity/v3/projects/f165e15e91ca4525ad7bac94224b29f2 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:48:04.064868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c0c5-7f8a-4c5f-b734-e37ede0c1e1b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:04.158623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c0c5-7f8a-4c5f-b734-e37ede0c1e1b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:04.160083 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:04.192893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08eaf2-73e8-4044-94c2-61bed51f928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:04.193522 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08eaf2-73e8-4044-94c2-61bed51f928e None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:04.193796 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08eaf2-73e8-4044-94c2-61bed51f928e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:04.194063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08eaf2-73e8-4044-94c2-61bed51f928e None admin] PATH_INFO: `/v3/projects/f165e15e91ca4525ad7bac94224b29f2/users/eecb3e71d5384f52add154cf69fd22a6/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:04.195950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08eaf2-73e8-4044-94c2-61bed51f928e None admin] RBAC: Authorizing `identity:create_grant(project_id=f165e15e91ca4525ad7bac94224b29f2, user_id=eecb3e71d5384f52add154cf69fd22a6, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:04.197358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08eaf2-73e8-4044-94c2-61bed51f928e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:04.209524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 446/897] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:48:04 2022] PUT /identity/v3/projects/f165e15e91ca4525ad7bac94224b29f2/users/eecb3e71d5384f52add154cf69fd22a6/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:48:06.327941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fdb35-888f-4842-8964-5d5a08e48451 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:06.328464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fdb35-888f-4842-8964-5d5a08e48451 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:06.328464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fdb35-888f-4842-8964-5d5a08e48451 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:06.329728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 452/898] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:48:06.334839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cc17-4dd9-4f34-a48f-349bc659e1b0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:06.335221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cc17-4dd9-4f34-a48f-349bc659e1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:06.335380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cc17-4dd9-4f34-a48f-349bc659e1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:06.353400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8014cc17-4dd9-4f34-a48f-349bc659e1b0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:48:06.354593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8014cc17-4dd9-4f34-a48f-349bc659e1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:48:06.417688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 447/899] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:48:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:48:06.681617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fdb35-888f-4842-8964-5d5a08e48451 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:06.781882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fdb35-888f-4842-8964-5d5a08e48451 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:06.814642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19803d5-cc7f-4295-b842-214666dafdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:06.815263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19803d5-cc7f-4295-b842-214666dafdbe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:06.815545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19803d5-cc7f-4295-b842-214666dafdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:06.815821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19803d5-cc7f-4295-b842-214666dafdbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:06.826227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19803d5-cc7f-4295-b842-214666dafdbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a19803d5-cc7f-4295-b842-214666dafdbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:48:06.831006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:48:06.832098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:48:06.833133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 453/900] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:48:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:48:06.837961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014cc17-4dd9-4f34-a48f-349bc659e1b0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:06.924750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:06.933941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014cc17-4dd9-4f34-a48f-349bc659e1b0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:06.966971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:06.967567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:06.967845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:06.968117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:06.968773 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:48:06.969075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:06.970439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:06.978133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 448/901] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:48:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:48:06.985484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19803d5-cc7f-4295-b842-214666dafdbe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:07.043189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:07.083863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19803d5-cc7f-4295-b842-214666dafdbe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:07.117178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f36387-7efd-4eac-b3dd-6e1899f82fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:07.117794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f36387-7efd-4eac-b3dd-6e1899f82fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:07.118073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f36387-7efd-4eac-b3dd-6e1899f82fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:07.118344 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f36387-7efd-4eac-b3dd-6e1899f82fe1 None admin] PATH_INFO: `/v3/users/eecb3e71d5384f52add154cf69fd22a6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:07.119482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f36387-7efd-4eac-b3dd-6e1899f82fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=eecb3e71d5384f52add154cf69fd22a6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:07.120895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f36387-7efd-4eac-b3dd-6e1899f82fe1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:07.123085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 454/902] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Oct 10 16:48:06 2022] GET /identity/v3/users/eecb3e71d5384f52add154cf69fd22a6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:48:07.129340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:07.224817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd371d-b680-462f-9818-fdf2b8d6ef7d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:07.256811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86510-5a80-48ba-8010-95dcedd58fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:07.257392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86510-5a80-48ba-8010-95dcedd58fab None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:07.257666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86510-5a80-48ba-8010-95dcedd58fab None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:07.257937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86510-5a80-48ba-8010-95dcedd58fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:07.280955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:07.322953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd86510-5a80-48ba-8010-95dcedd58fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:07.324380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd86510-5a80-48ba-8010-95dcedd58fab None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:07.418301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 449/903] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:48:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:48:07.424154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f36387-7efd-4eac-b3dd-6e1899f82fe1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:07.521922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f36387-7efd-4eac-b3dd-6e1899f82fe1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:07.546178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:07.554841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693579bb-0b51-43db-9a26-51a542bda448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:07.555460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693579bb-0b51-43db-9a26-51a542bda448 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:07.555736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693579bb-0b51-43db-9a26-51a542bda448 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:07.556008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693579bb-0b51-43db-9a26-51a542bda448 None admin] PATH_INFO: `/v3/projects/f165e15e91ca4525ad7bac94224b29f2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:07.557101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693579bb-0b51-43db-9a26-51a542bda448 None admin] RBAC: Authorizing `identity:get_project(project_id=f165e15e91ca4525ad7bac94224b29f2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:07.558501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693579bb-0b51-43db-9a26-51a542bda448 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:07.560824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 455/904] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Oct 10 16:48:07 2022] GET /identity/v3/projects/f165e15e91ca4525ad7bac94224b29f2 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:48:07.566814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86510-5a80-48ba-8010-95dcedd58fab None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:48:07.618964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:07.662214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86510-5a80-48ba-8010-95dcedd58fab None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:48:07.694988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc6286-931a-4f19-8f4d-ae6ecc9a6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:48:07.695566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6286-931a-4f19-8f4d-ae6ecc9a6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:48:07.695839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6286-931a-4f19-8f4d-ae6ecc9a6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:48:07.696107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6286-931a-4f19-8f4d-ae6ecc9a6ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:48:07.696812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc6286-931a-4f19-8f4d-ae6ecc9a6ab3 None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=f165e15e91ca4525ad7bac94224b29f2, user.id=eecb3e71d5384f52add154cf69fd22a6) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:48:07.697113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc6286-931a-4f19-8f4d-ae6ecc9a6ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:48:07.698512 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc6286-931a-4f19-8f4d-ae6ecc9a6ab3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:48:07.704100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 450/905] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:48:07 2022] GET /identity/v3/role_assignments?user.id=eecb3e71d5384f52add154cf69fd22a6&scope.project.id=f165e15e91ca4525ad7bac94224b29f2&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:48:17.550899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:48:17.701592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=41 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:03.657753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ca26-39c2-4fed-9777-cf9d06756961 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:03.657753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ca26-39c2-4fed-9777-cf9d06756961 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:03.657753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ca26-39c2-4fed-9777-cf9d06756961 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:03.657753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 456/906] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:49:03.663791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601bb5-b9d8-45a7-b8e2-44e578da518f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:03.664287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601bb5-b9d8-45a7-b8e2-44e578da518f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:03.664373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601bb5-b9d8-45a7-b8e2-44e578da518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:03.684334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-17601bb5-b9d8-45a7-b8e2-44e578da518f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:03.685859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-17601bb5-b9d8-45a7-b8e2-44e578da518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:03.786009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 451/907] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:49:04.083904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05ca26-39c2-4fed-9777-cf9d06756961 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:04.217016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05ca26-39c2-4fed-9777-cf9d06756961 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:04.262134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:04.262786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:04.263064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:04.263339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:04.274600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:04.276045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:04.296784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:04.298110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:04.299403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:04.299403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:04.299403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:04.300931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 457/908] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:04.310194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601bb5-b9d8-45a7-b8e2-44e578da518f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:04.449413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601bb5-b9d8-45a7-b8e2-44e578da518f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:04.487049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:04.494901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc05705-6d1e-40ed-949e-596df5feebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:04.495703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05705-6d1e-40ed-949e-596df5feebe2 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:04.496059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05705-6d1e-40ed-949e-596df5feebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:04.496406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05705-6d1e-40ed-949e-596df5feebe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:04.497204 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc05705-6d1e-40ed-949e-596df5feebe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:04.497525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc05705-6d1e-40ed-949e-596df5feebe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:04.499472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc05705-6d1e-40ed-949e-596df5feebe2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:04.517607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 452/909] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:04.524132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:04.599072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:04.665522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d3697-dfaa-4fed-82b1-5488f3e9a925 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:04.705048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50891458-05df-405d-b227-0e87b47db4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:04.705706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891458-05df-405d-b227-0e87b47db4c7 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:04.705991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891458-05df-405d-b227-0e87b47db4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:04.706304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891458-05df-405d-b227-0e87b47db4c7 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:04.707080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50891458-05df-405d-b227-0e87b47db4c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:04.708609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50891458-05df-405d-b227-0e87b47db4c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:04.741265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 458/910] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Oct 10 16:49:04 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:49:07.193972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2069a5-31fb-4515-8b18-2e486bc625d9 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:07.194539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2069a5-31fb-4515-8b18-2e486bc625d9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:07.194539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2069a5-31fb-4515-8b18-2e486bc625d9 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:07.195968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 453/911] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:49:07.202455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62940-4eac-4f3c-8add-19ccc558ddf9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:07.204727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62940-4eac-4f3c-8add-19ccc558ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:07.204727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62940-4eac-4f3c-8add-19ccc558ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:07.222719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-04c62940-4eac-4f3c-8add-19ccc558ddf9 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:07.224056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-04c62940-4eac-4f3c-8add-19ccc558ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:07.301966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 459/912] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:49:07.584120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2069a5-31fb-4515-8b18-2e486bc625d9 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:07.719166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2069a5-31fb-4515-8b18-2e486bc625d9 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:07.762795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362ea1f-411b-4938-9f0d-5c470ed61e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:07.763494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ea1f-411b-4938-9f0d-5c470ed61e09 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:07.763856 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ea1f-411b-4938-9f0d-5c470ed61e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:07.764224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ea1f-411b-4938-9f0d-5c470ed61e09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:07.776447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362ea1f-411b-4938-9f0d-5c470ed61e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-5362ea1f-411b-4938-9f0d-5c470ed61e09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:49:07.782797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:07.783750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:07.784585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 454/913] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:49:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:07.789326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c62940-4eac-4f3c-8add-19ccc558ddf9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:07.834953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:07.901576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c62940-4eac-4f3c-8add-19ccc558ddf9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:07.940696 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:07.941398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:07.941618 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:07.941909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:07.942650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:07.942956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:07.944333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:07.953629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 460/914] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:49:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:07.959390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362ea1f-411b-4938-9f0d-5c470ed61e09 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:08.022252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:08.085387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362ea1f-411b-4938-9f0d-5c470ed61e09 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:08.130764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:08.131904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:08.132282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:08.132629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:08.148014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:08.149677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:08.166720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:08.168451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:08.169353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:08.169353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:08.169353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:08.169353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 455/915] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:08.175225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:08.287560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:08.292950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b8c3-6bbc-49b0-97c8-8b3fd2dbdcc4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:08.349120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:08.349756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:08.350056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:08.350330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:08.351029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:08.351337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:08.352868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:08.371592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 461/916] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:08.377853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:08.490314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7ceb-ce57-448b-94f1-2f6cd9235275 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:08.492220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:08.533109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:08.533742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:08.534015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:08.534293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:08.542832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:08.544269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:49:08.556923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:08.563006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:08.564544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 456/917] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:08.565281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:08.680662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54f015-ff28-4b6f-9797-b5e62b74d4b7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:08.726282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:08.727195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:08.727610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:08.728138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:08.729106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:08.729606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:08.731409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:08.758556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 462/918] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Oct 10 16:49:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:08.758738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:08.864398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a1396-56da-427d-b80e-0f99c7184616 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:08.908073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:08.908708 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:08.908989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:08.909262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:08.921621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:08.923115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:08.939827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:08.941105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:08.942174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:08.942174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:08.942174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:08.948105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 457/919] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:08.949246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:08.972983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:09.064685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03e00-362e-4a42-979d-cc7185c067d2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:09.103012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:09.103633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:09.103915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:09.104190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:09.105351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:09.105650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:09.107049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:09.119687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 463/920] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:09.127060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:09.153566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:09.250923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568636c-8ee7-4cb8-bb3a-3fcb2a676977 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:09.289524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:09.290171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:09.290558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:09.290835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:09.299409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:09.301002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:49:09.313739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:09.319781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:09.320684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 458/921] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:09.321201 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:09.428840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:09.457109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956beff-a516-460e-8efd-6bc0b3ec2765 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:09.502271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10bd58-e7fb-459c-bcb8-dd0f691affa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:09.502949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bd58-e7fb-459c-bcb8-dd0f691affa1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:09.503314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bd58-e7fb-459c-bcb8-dd0f691affa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:09.503645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bd58-e7fb-459c-bcb8-dd0f691affa1 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:09.504573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10bd58-e7fb-459c-bcb8-dd0f691affa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:09.504934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10bd58-e7fb-459c-bcb8-dd0f691affa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:09.507271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10bd58-e7fb-459c-bcb8-dd0f691affa1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:09.525825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 464/922] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:09.535129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:09.627565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:09.657362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b24231-d5d2-496d-bc35-35c5fe1f440c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:09.697838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93683d33-733f-456c-95c1-acdf08dbc277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:09.699356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93683d33-733f-456c-95c1-acdf08dbc277 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:09.699683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93683d33-733f-456c-95c1-acdf08dbc277 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:09.699959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93683d33-733f-456c-95c1-acdf08dbc277 None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/6ad8898f985c41789f17984ef13bf5eb/roles/69a9c12b055c4403bb98c1079613718c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:09.716048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93683d33-733f-456c-95c1-acdf08dbc277 None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=6ad8898f985c41789f17984ef13bf5eb, role_id=69a9c12b055c4403bb98c1079613718c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:09.717482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93683d33-733f-456c-95c1-acdf08dbc277 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:09.731193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 459/923] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:49:09 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/6ad8898f985c41789f17984ef13bf5eb/roles/69a9c12b055c4403bb98c1079613718c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:49:11.995879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34475fe-12f3-4d67-a566-c3e7643025bc None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:11.996500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34475fe-12f3-4d67-a566-c3e7643025bc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:11.996500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34475fe-12f3-4d67-a566-c3e7643025bc None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:11.997944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 465/924] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:49:12.003916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe526a-807c-4682-a6f5-de70035ce067 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:12.004374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe526a-807c-4682-a6f5-de70035ce067 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:12.004509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe526a-807c-4682-a6f5-de70035ce067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:12.023990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-18fe526a-807c-4682-a6f5-de70035ce067 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:12.025163 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-18fe526a-807c-4682-a6f5-de70035ce067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:12.101991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 460/925] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:49:12.369592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34475fe-12f3-4d67-a566-c3e7643025bc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:12.488198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34475fe-12f3-4d67-a566-c3e7643025bc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:12.535351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6809e7-bc0b-4c41-8b99-65dd60683d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:12.536030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6809e7-bc0b-4c41-8b99-65dd60683d2b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:12.536307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6809e7-bc0b-4c41-8b99-65dd60683d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:12.536618 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6809e7-bc0b-4c41-8b99-65dd60683d2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:12.545244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:12.549901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6809e7-bc0b-4c41-8b99-65dd60683d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ef6809e7-bc0b-4c41-8b99-65dd60683d2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:49:12.555798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:12.557045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:12.558362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 466/926] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Oct 10 16:49:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:12.563565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe526a-807c-4682-a6f5-de70035ce067 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:12.627194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:12.678509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe526a-807c-4682-a6f5-de70035ce067 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:12.716910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:12.717555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:12.717841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:12.718132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:12.718941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:12.719269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:12.720695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:12.729192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 461/927] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Oct 10 16:49:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:12.735273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6809e7-bc0b-4c41-8b99-65dd60683d2b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:12.858202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6809e7-bc0b-4c41-8b99-65dd60683d2b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:12.901637 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:12.902495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:12.902820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:12.903151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:12.913619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:12.915115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:12.932190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:12.933361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:12.939773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:12.939773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:12.939773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:12.939773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 467/928] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:12.940382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:13.052758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7da5-09a3-41c2-966d-46080758e161 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:13.070899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:13.092474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:13.093213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:13.093579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:13.093916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:13.094680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:13.095081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:13.096821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:13.111891 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 462/929] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:13.117569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:13.170888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:13.222725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ae032-1863-4043-9525-a2ad67b013fe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:13.258756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:13.259416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:13.259667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:13.259937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:13.267413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:13.268822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:49:13.280805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:13.281882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:13.282949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 468/930] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:13.287703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:13.399754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83131299-eaed-40f2-b231-49bca76ba116 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:13.440711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:13.440711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:13.440988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:13.441198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:13.441904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:13.442211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:13.443674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:13.462472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 463/931] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Oct 10 16:49:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:49:13.468960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:13.588456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c3ca0-efdf-4f24-b4da-aaf5549b1741 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:13.599142 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:13.624756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52605cbb-86ff-4953-8dca-335392c0f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:13.625361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605cbb-86ff-4953-8dca-335392c0f613 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:13.625639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605cbb-86ff-4953-8dca-335392c0f613 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:13.625916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605cbb-86ff-4953-8dca-335392c0f613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:13.707048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52605cbb-86ff-4953-8dca-335392c0f613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:13.708571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52605cbb-86ff-4953-8dca-335392c0f613 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:13.824812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 469/932] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:49:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:49:13.825885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:13.861069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:13.932794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6ed3-9ef8-4c10-b041-5b44ce14a4a0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:13.968376 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:13.968910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:13.969185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:13.969456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:13.979719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:13.981342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:13.996848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:13.998026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:13.999484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:13.999484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:13.999484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:13.999484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 464/933] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:14.005851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52605cbb-86ff-4953-8dca-335392c0f613 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:14.019027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:14.121860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52605cbb-86ff-4953-8dca-335392c0f613 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:14.159352 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:14.159959 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:14.160235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:14.160509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:14.161192 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:14.161570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:14.163010 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:14.180127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 470/934] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:14.181330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:14.268313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:14.285618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafd991-6f8b-4766-b4bf-4a44a4f85710 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:14.322156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:14.323519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:14.324066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:14.324199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:14.331397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:14.333047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:49:14.345027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:14.346089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:14.347052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 465/935] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:14.352357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:14.428848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:14.462320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695691a4-564c-40c0-91b8-4622a648493d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:14.509301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ed73-d96a-44ff-803e-f6f11cecd1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:14.510362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ed73-d96a-44ff-803e-f6f11cecd1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:14.511793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ed73-d96a-44ff-803e-f6f11cecd1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:14.512270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ed73-d96a-44ff-803e-f6f11cecd1b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:14.513341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ed73-d96a-44ff-803e-f6f11cecd1b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:14.513853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ed73-d96a-44ff-803e-f6f11cecd1b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:14.516007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ed73-d96a-44ff-803e-f6f11cecd1b7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:14.536840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 471/936] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:49:14.538028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:14.649121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8918e-2408-44e4-aa33-f5eb6a22042d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:14.685610 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ed41e-72b4-41ca-a3e9-5b7e455df7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:14.686213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ed41e-72b4-41ca-a3e9-5b7e455df7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:14.686489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ed41e-72b4-41ca-a3e9-5b7e455df7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:14.686925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ed41e-72b4-41ca-a3e9-5b7e455df7a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:14.687646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ed41e-72b4-41ca-a3e9-5b7e455df7a1 None admin] RBAC: Adding query filter params (role.id=69a9c12b055c4403bb98c1079613718c, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=6ad8898f985c41789f17984ef13bf5eb) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:14.687952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ed41e-72b4-41ca-a3e9-5b7e455df7a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:14.689378 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ed41e-72b4-41ca-a3e9-5b7e455df7a1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:14.695123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 466/937] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:49:14 2022] GET /identity/v3/role_assignments?user.id=6ad8898f985c41789f17984ef13bf5eb&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=69a9c12b055c4403bb98c1079613718c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:16.874698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e4bf-3a54-4335-a560-b0161b822c13 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:16.875375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e4bf-3a54-4335-a560-b0161b822c13 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:16.875375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e4bf-3a54-4335-a560-b0161b822c13 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:16.876559 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 472/938] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:49:16.882408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e356-e479-4744-a099-586e6de75654 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:16.882859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e356-e479-4744-a099-586e6de75654 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:16.882996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e356-e479-4744-a099-586e6de75654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:16.902777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9612e356-e479-4744-a099-586e6de75654 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:16.903968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9612e356-e479-4744-a099-586e6de75654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:16.907395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:16.978055 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 467/939] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:49:17.262552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71e4bf-3a54-4335-a560-b0161b822c13 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:17.385707 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71e4bf-3a54-4335-a560-b0161b822c13 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:17.419842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:17.426375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645211d8-7662-4258-b9f1-43f2730e53c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:17.427053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645211d8-7662-4258-b9f1-43f2730e53c9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:17.427313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645211d8-7662-4258-b9f1-43f2730e53c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:17.427586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645211d8-7662-4258-b9f1-43f2730e53c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:17.438451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645211d8-7662-4258-b9f1-43f2730e53c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-645211d8-7662-4258-b9f1-43f2730e53c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:49:17.443441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:17.444651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:17.445667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 473/940] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:17.453645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e356-e479-4744-a099-586e6de75654 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:17.581435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e356-e479-4744-a099-586e6de75654 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:17.616824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:17.617485 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:17.617807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:17.618053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:17.618729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:17.619019 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:17.621024 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:17.629482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 468/941] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:49:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:17.635540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645211d8-7662-4258-b9f1-43f2730e53c9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:17.748044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645211d8-7662-4258-b9f1-43f2730e53c9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:17.788084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:17.788716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:17.788993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:17.789265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:17.799306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:17.800742 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:17.816297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:17.817427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:17.818510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:17.818510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:17.818510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:17.822162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 474/942] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:17.823985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:17.827218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:17.945787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3d8a3-4ae6-45f8-8d25-508697f52012 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:17.984530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:17.985163 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:17.985445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:17.985717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:17.986352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:17.986687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:17.988045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:18.002827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 469/943] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:18.008689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:18.059052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:18.117316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4bee-8812-4f20-8557-cdbc1f2ea511 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:18.153638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:18.154306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:18.154650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:18.155003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:18.163857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:18.165554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:49:18.178900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:18.180019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:18.181198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 475/944] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:18.186580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:18.254602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:18.300033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896df9-c5fb-45c9-a9e6-faa0220ec4cd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:18.337812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:18.338972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:18.339668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:18.339782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:18.340439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:18.340722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:18.342139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:18.360204 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 470/945] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Oct 10 16:49:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:18.366935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:18.479833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b6fa-147b-4a53-94e3-f65e08e4fd2b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:18.481549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:18.520319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:18.520933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:18.521213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:18.521592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:18.534505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:18.536135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:18.552187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:18.553703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:18.554616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:18.554616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:18.554616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:18.554616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 476/946] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:18.559501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:18.663444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6af95-0d69-4a38-b811-979f9dc9a7d5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:18.685183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:18.701040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:18.701654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:18.701936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:18.702198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:18.702885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:18.703175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:18.704541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:18.717228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 471/947] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:18.723090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:18.835817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368d95b-fb5d-4797-999a-a6b0c9a829ed None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:18.876132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:18.876759 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:18.877035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:18.877308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:18.886069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:18.887562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:49:18.900445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:18.902534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:18.903773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 477/948] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:49:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:18.908368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:19.020839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615b27-2642-415b-9282-a51df2b63e43 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:19.057602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907beb6b-e258-4b7e-ad30-e6ba624e62e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:19.058134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907beb6b-e258-4b7e-ad30-e6ba624e62e8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:19.058416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907beb6b-e258-4b7e-ad30-e6ba624e62e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:19.058717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907beb6b-e258-4b7e-ad30-e6ba624e62e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:19.059589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907beb6b-e258-4b7e-ad30-e6ba624e62e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:19.059923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907beb6b-e258-4b7e-ad30-e6ba624e62e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:19.061480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907beb6b-e258-4b7e-ad30-e6ba624e62e8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:19.075743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 472/949] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:49:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:19.081864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:19.099874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:19.195643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78578c4-1332-492c-8922-ab90d5de8fbb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:19.232990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aabb65-b968-402b-a8df-abe9d56ac2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:19.233652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabb65-b968-402b-a8df-abe9d56ac2ef None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:19.233931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabb65-b968-402b-a8df-abe9d56ac2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:19.234212 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabb65-b968-402b-a8df-abe9d56ac2ef None admin] PATH_INFO: `/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/6ad8898f985c41789f17984ef13bf5eb/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:19.236196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aabb65-b968-402b-a8df-abe9d56ac2ef None admin] RBAC: Authorizing `identity:create_grant(project_id=0155ef40a1c64e77b5d5e8e64498a24c, user_id=6ad8898f985c41789f17984ef13bf5eb, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:19.237615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aabb65-b968-402b-a8df-abe9d56ac2ef None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:19.250555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 478/950] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Oct 10 16:49:19 2022] PUT /identity/v3/projects/0155ef40a1c64e77b5d5e8e64498a24c/users/6ad8898f985c41789f17984ef13bf5eb/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:49:21.796936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a029e-5aed-4867-b77d-ea27b448f152 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:21.797467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a029e-5aed-4867-b77d-ea27b448f152 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:21.797467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a029e-5aed-4867-b77d-ea27b448f152 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:21.798873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 473/951] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:49:21.804933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a964b-2db5-4a7f-b7e9-35367eb67bf0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:21.805335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a964b-2db5-4a7f-b7e9-35367eb67bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:21.805477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a964b-2db5-4a7f-b7e9-35367eb67bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:21.828238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-177a964b-2db5-4a7f-b7e9-35367eb67bf0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:21.829644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-177a964b-2db5-4a7f-b7e9-35367eb67bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:21.900007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 479/952] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:49:22.225073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a029e-5aed-4867-b77d-ea27b448f152 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:22.275245 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:22.338128 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a029e-5aed-4867-b77d-ea27b448f152 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:22.378661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8684425-d834-4d95-bd83-465bd9b8e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:22.379355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684425-d834-4d95-bd83-465bd9b8e71e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:22.379739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684425-d834-4d95-bd83-465bd9b8e71e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:22.380049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8684425-d834-4d95-bd83-465bd9b8e71e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:22.390481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8684425-d834-4d95-bd83-465bd9b8e71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b8684425-d834-4d95-bd83-465bd9b8e71e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 16:49:22.395172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:22.396231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 16:49:22.397085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:22.398697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 474/953] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Oct 10 16:49:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:22.402551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a964b-2db5-4a7f-b7e9-35367eb67bf0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:22.406588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:22.521507 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a964b-2db5-4a7f-b7e9-35367eb67bf0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:22.569578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:22.570198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:22.570512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:22.570845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:22.571540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:22.571878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:22.573458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:22.582288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 480/954] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Oct 10 16:49:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:22.588792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8684425-d834-4d95-bd83-465bd9b8e71e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:22.695659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:22.700453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8684425-d834-4d95-bd83-465bd9b8e71e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:22.737351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:22.738374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:22.738895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:22.739370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:22.756790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:22.759427 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:22.784719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:22.785974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:22.787171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:22.787171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:22.787171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:22.787171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 475/955] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:22.793516 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:22.867685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:22.908839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542468d4-43f3-4aab-a9f7-d05eed8572a1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:22.945736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:22.946446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:22.946757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:22.947092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:22.948474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:22.948818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:22.950315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:22.964189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 481/956] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:22.970133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:23.085384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717c697-fc15-4b22-8350-f67f3255803d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:23.122591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:23.123322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:23.123961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:23.124204 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:23.132177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:23.133614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 16:49:23.146625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:23.147670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:23.148641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 476/957] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:23.153925 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:23.266814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6fd5-779f-4be3-b35a-beff69d37863 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:23.294741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:23.303937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:23.304546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:23.304826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:23.305134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:23.305825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:23.306127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:23.308415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:23.329308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 482/958] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Oct 10 16:49:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:49:23.335369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:23.352214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:23.450912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccdf98-90c0-45a7-b563-a110fb8ea577 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:23.487334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e90a6-0aba-4e15-b937-5e7865de196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:23.487977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e90a6-0aba-4e15-b937-5e7865de196f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:23.488255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e90a6-0aba-4e15-b937-5e7865de196f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:23.488553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e90a6-0aba-4e15-b937-5e7865de196f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:23.571826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e90a6-0aba-4e15-b937-5e7865de196f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:23.573609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e90a6-0aba-4e15-b937-5e7865de196f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:23.589178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:23.679370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 477/959] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Oct 10 16:49:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 16:49:23.685487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:23.792784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d00a-855b-4242-9662-6c8985a1f591 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:23.828235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:23.828868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:23.829155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:23.829425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:23.839704 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:23.841148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 16:49:23.857240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:23.858227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 16:49:23.859177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 16:49:23.859177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 16:49:23.859177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:23.859177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 483/960] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:23.864124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e90a6-0aba-4e15-b937-5e7865de196f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:23.966560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e90a6-0aba-4e15-b937-5e7865de196f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:23.982265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:24.004107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:24.004711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:24.005082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:24.005360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:24.006003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:24.006304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:24.007729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:24.019059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 478/961] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Oct 10 16:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:24.024926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:24.062162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:24.127587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f701-ab98-4cda-b331-e5b28336233d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:24.159459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:24.160075 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:24.160350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:24.160618 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:24.167578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:24.168989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 16:49:24.179736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:24.180735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 10 16:49:24.181793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 484/962] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Oct 10 16:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:24.188175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:24.285189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aba16d-1046-4cdf-ae21-58aa005625d3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:24.317816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879365c-3aca-4c70-90e8-5eb8b6e34317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:24.318402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879365c-3aca-4c70-90e8-5eb8b6e34317 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:24.318704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879365c-3aca-4c70-90e8-5eb8b6e34317 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:24.318973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879365c-3aca-4c70-90e8-5eb8b6e34317 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:24.319648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879365c-3aca-4c70-90e8-5eb8b6e34317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:24.319950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879365c-3aca-4c70-90e8-5eb8b6e34317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:24.321363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879365c-3aca-4c70-90e8-5eb8b6e34317 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:24.332968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 479/963] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Oct 10 16:49:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:24.339470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:24.429781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:24.435963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ef1f9-4a53-4585-baae-6141c758b59d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:24.468557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeebbf6-bf3e-44b5-868a-0dd8b4f1067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:24.469135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeebbf6-bf3e-44b5-868a-0dd8b4f1067a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:24.469407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeebbf6-bf3e-44b5-868a-0dd8b4f1067a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:24.469674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeebbf6-bf3e-44b5-868a-0dd8b4f1067a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:24.470379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeebbf6-bf3e-44b5-868a-0dd8b4f1067a None admin] RBAC: Adding query filter params (role.id=2cefd0eca47446b7bfec36298dd71193, scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c, user.id=6ad8898f985c41789f17984ef13bf5eb) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:24.470713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeebbf6-bf3e-44b5-868a-0dd8b4f1067a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:24.472117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeebbf6-bf3e-44b5-868a-0dd8b4f1067a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:24.477613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 485/964] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Oct 10 16:49:24 2022] GET /identity/v3/role_assignments?user.id=6ad8898f985c41789f17984ef13bf5eb&scope.project.id=0155ef40a1c64e77b5d5e8e64498a24c&role.id=2cefd0eca47446b7bfec36298dd71193 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:26.628769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779421b3-7135-43e9-962b-37d37195f5ac None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:26.629475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779421b3-7135-43e9-962b-37d37195f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:26.629475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779421b3-7135-43e9-962b-37d37195f5ac None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:26.630682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 480/965] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:49:26.637174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3b1cc-4c10-4db7-b649-730d97a98e7a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:26.637632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3b1cc-4c10-4db7-b649-730d97a98e7a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:26.637778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3b1cc-4c10-4db7-b649-730d97a98e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:26.658719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bff3b1cc-4c10-4db7-b649-730d97a98e7a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:26.659930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bff3b1cc-4c10-4db7-b649-730d97a98e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:26.729427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 486/966] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:49:26.996210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779421b3-7135-43e9-962b-37d37195f5ac None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:27.026481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:27.096929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779421b3-7135-43e9-962b-37d37195f5ac None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:27.129723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:27.130332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:27.130632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:27.130900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:27.131468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:27.132810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:27.141240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:27.142484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:27.143680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:27.146672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 481/967] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Oct 10 16:49:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:27.148340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3b1cc-4c10-4db7-b649-730d97a98e7a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:27.235111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:27.244639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3b1cc-4c10-4db7-b649-730d97a98e7a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:27.277569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310fdf5-0ec6-4bee-b12c-c8a230cf598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:27.278165 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310fdf5-0ec6-4bee-b12c-c8a230cf598c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:27.278444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310fdf5-0ec6-4bee-b12c-c8a230cf598c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:27.278741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310fdf5-0ec6-4bee-b12c-c8a230cf598c None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:27.279362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310fdf5-0ec6-4bee-b12c-c8a230cf598c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:27.279659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310fdf5-0ec6-4bee-b12c-c8a230cf598c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:27.280999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310fdf5-0ec6-4bee-b12c-c8a230cf598c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:27.285602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 487/968] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Oct 10 16:49:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:27.291863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:27.382174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:27.388427 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4868e-d5e2-4022-82dd-969751849e8b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:27.421531 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f180f-0401-4eee-b7aa-9d2f78b61efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:27.422052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f180f-0401-4eee-b7aa-9d2f78b61efd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:27.422326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f180f-0401-4eee-b7aa-9d2f78b61efd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:27.422627 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f180f-0401-4eee-b7aa-9d2f78b61efd None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:27.423242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f180f-0401-4eee-b7aa-9d2f78b61efd None admin] RBAC: Adding query filter params (type=placement) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:27.423537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f180f-0401-4eee-b7aa-9d2f78b61efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:27.424880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f180f-0401-4eee-b7aa-9d2f78b61efd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:27.429230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 482/969] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Oct 10 16:49:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:29.550883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5fb98-e7e8-454e-bca2-b5cecd1d8a8c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:29.551442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5fb98-e7e8-454e-bca2-b5cecd1d8a8c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:29.551442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5fb98-e7e8-454e-bca2-b5cecd1d8a8c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:29.552770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 488/970] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:49:29.557930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78755e-c33a-4f81-8a29-87e14dafe164 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:29.558351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78755e-c33a-4f81-8a29-87e14dafe164 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:29.558480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78755e-c33a-4f81-8a29-87e14dafe164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:29.577089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-cd78755e-c33a-4f81-8a29-87e14dafe164 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:29.578266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cd78755e-c33a-4f81-8a29-87e14dafe164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:29.643230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 483/971] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:49:29.912922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5fb98-e7e8-454e-bca2-b5cecd1d8a8c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:30.013328 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5fb98-e7e8-454e-bca2-b5cecd1d8a8c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:30.046628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca81e0-e81e-4325-a1e7-5bf5c3b641c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:30.047229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca81e0-e81e-4325-a1e7-5bf5c3b641c7 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:30.047510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca81e0-e81e-4325-a1e7-5bf5c3b641c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:30.047789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca81e0-e81e-4325-a1e7-5bf5c3b641c7 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:30.048434 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca81e0-e81e-4325-a1e7-5bf5c3b641c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:30.049791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca81e0-e81e-4325-a1e7-5bf5c3b641c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:30.064501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 489/972] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Oct 10 16:49:29 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:49:32.245431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac195-81d1-41c4-aba2-2006391fae12 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:32.245958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac195-81d1-41c4-aba2-2006391fae12 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:32.245958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ac195-81d1-41c4-aba2-2006391fae12 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:32.247278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 484/973] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:49:32.252655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071dad5-34a9-45d0-903a-99ef94643aa5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:32.253101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071dad5-34a9-45d0-903a-99ef94643aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:32.253209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071dad5-34a9-45d0-903a-99ef94643aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:32.271767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1071dad5-34a9-45d0-903a-99ef94643aa5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:32.272939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1071dad5-34a9-45d0-903a-99ef94643aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:32.282169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:32.344377 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 490/974] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 16:49:32.613875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ac195-81d1-41c4-aba2-2006391fae12 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:32.700579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:32.710677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ac195-81d1-41c4-aba2-2006391fae12 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:32.743098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:32.743709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:32.744029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:32.744301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:32.744871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:32.746215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:32.754859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:32.756059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:32.757268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 485/975] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Oct 10 16:49:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:32.762420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071dad5-34a9-45d0-903a-99ef94643aa5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:32.858710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071dad5-34a9-45d0-903a-99ef94643aa5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:32.892038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:32.892642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:32.892919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:32.893682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:32.893808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:32.894108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:32.895504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:32.901366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 491/976] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Oct 10 16:49:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:32.907239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:33.005352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfefa86-bde9-4ef8-8ab2-293235fb3ddc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:33.038122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d40db-58e1-43aa-83c1-76a5b34ac7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:33.038735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d40db-58e1-43aa-83c1-76a5b34ac7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:33.039010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d40db-58e1-43aa-83c1-76a5b34ac7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:33.039278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d40db-58e1-43aa-83c1-76a5b34ac7c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:33.039959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d40db-58e1-43aa-83c1-76a5b34ac7c4 None admin] RBAC: Adding query filter params (interface=public, service_id=d09c083e80774080bed942c3cd62e1f0, region_id=RegionOne) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:33.040260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d40db-58e1-43aa-83c1-76a5b34ac7c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:33.041772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d40db-58e1-43aa-83c1-76a5b34ac7c4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:33.046591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 486/977] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Oct 10 16:49:32 2022] GET /identity/v3/endpoints?service_id=d09c083e80774080bed942c3cd62e1f0&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:33.052141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:33.055830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:33.149705 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c1670-9ba1-45ee-9be4-27c4552aa692 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:33.182247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80a7bd-a0c1-4842-8339-0cf885c7aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:33.182869 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80a7bd-a0c1-4842-8339-0cf885c7aa04 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:33.183145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80a7bd-a0c1-4842-8339-0cf885c7aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:33.183415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80a7bd-a0c1-4842-8339-0cf885c7aa04 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:33.184004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80a7bd-a0c1-4842-8339-0cf885c7aa04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:33.185343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80a7bd-a0c1-4842-8339-0cf885c7aa04 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:33.191870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 492/978] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Oct 10 16:49:33 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:49:35.328547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d9e3e-3bf9-4d17-adf6-1ab8cb6cd487 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:35.329068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d9e3e-3bf9-4d17-adf6-1ab8cb6cd487 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:35.329068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d9e3e-3bf9-4d17-adf6-1ab8cb6cd487 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:35.330318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 487/979] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:49:35.335667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8d9cc-9ab3-4f50-a17b-7e00ca0671cf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:35.336054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8d9cc-9ab3-4f50-a17b-7e00ca0671cf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:35.336226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8d9cc-9ab3-4f50-a17b-7e00ca0671cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:35.355706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9eb8d9cc-9ab3-4f50-a17b-7e00ca0671cf None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:49:35.356881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9eb8d9cc-9ab3-4f50-a17b-7e00ca0671cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:49:35.417950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:35.423813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 493/980] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:49:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 16:49:35.712680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d9e3e-3bf9-4d17-adf6-1ab8cb6cd487 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:35.732065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:35.812031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d9e3e-3bf9-4d17-adf6-1ab8cb6cd487 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:35.843222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:35.843826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:35.844098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:35.844366 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:35.844932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:35.846283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 16:49:35.855262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 16:49:35.856482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 10 16:49:35.857609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 488/981] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Oct 10 16:49:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 16:49:35.862228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8d9cc-9ab3-4f50-a17b-7e00ca0671cf None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:35.959769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8d9cc-9ab3-4f50-a17b-7e00ca0671cf None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:35.993365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d16ffa-133e-4917-9a28-6a8aa19be5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:35.994561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d16ffa-133e-4917-9a28-6a8aa19be5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:35.994842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d16ffa-133e-4917-9a28-6a8aa19be5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:35.995111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d16ffa-133e-4917-9a28-6a8aa19be5f1 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:35.995730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d16ffa-133e-4917-9a28-6a8aa19be5f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:49:35.996028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d16ffa-133e-4917-9a28-6a8aa19be5f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:35.997373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d16ffa-133e-4917-9a28-6a8aa19be5f1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:36.002557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 494/982] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Oct 10 16:49:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:49:36.008195 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:49:36.086960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:36.105731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364235-ca2e-4db4-ad1a-cf4e847c413a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:49:36.138389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3869-95cb-4c13-b992-0096368e9f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:49:36.139011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3869-95cb-4c13-b992-0096368e9f15 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:49:36.139292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3869-95cb-4c13-b992-0096368e9f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:49:36.139564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3869-95cb-4c13-b992-0096368e9f15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:49:36.140217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3869-95cb-4c13-b992-0096368e9f15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:49:36.141574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3869-95cb-4c13-b992-0096368e9f15 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:49:36.160409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 489/983] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:49:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:49:45.999744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=69 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:49:46.156369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:40.501400 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099534d-c829-42cc-ab4f-50c7c3696db6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:40.501884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099534d-c829-42cc-ab4f-50c7c3696db6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:40.501963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099534d-c829-42cc-ab4f-50c7c3696db6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:40.510789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d43419-40cf-49bc-8dc3-cd6896c3486b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:40.511241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d43419-40cf-49bc-8dc3-cd6896c3486b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:40.511321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d43419-40cf-49bc-8dc3-cd6896c3486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:40.514444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 495/984] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:50:40 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:50:40.592492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-63d43419-40cf-49bc-8dc3-cd6896c3486b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:50:40.594119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-63d43419-40cf-49bc-8dc3-cd6896c3486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:40.710210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 490/985] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:50:41.002822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4fe0-f6c5-47b2-8621-fe57a93f0155 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:41.003153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4fe0-f6c5-47b2-8621-fe57a93f0155 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:41.003432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4fe0-f6c5-47b2-8621-fe57a93f0155 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:41.004933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 496/986] 10.222.0.27 () {54 vars in 964 bytes} [Mon Oct 10 16:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:50:41.011637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1c19-6a49-4be2-b76f-ae9146cebc21 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:41.011930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1c19-6a49-4be2-b76f-ae9146cebc21 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:41.012209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1c19-6a49-4be2-b76f-ae9146cebc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:41.091376 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5e5f1c19-6a49-4be2-b76f-ae9146cebc21 None None] MFA Rules not processed for user `b3d805106909465abd09c0daf5ecc1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:50:41.092752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5e5f1c19-6a49-4be2-b76f-ae9146cebc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:41.117480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:41.184074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 491/987] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Oct 10 16:50:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:50:41.194432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4fe0-f6c5-47b2-8621-fe57a93f0155 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:50:41.196423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-881e4fe0-f6c5-47b2-8621-fe57a93f0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:41.331367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4fe0-f6c5-47b2-8621-fe57a93f0155 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:50:41.417542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcee43-8357-437d-9d58-51306c4fcf50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:50:41.418154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcee43-8357-437d-9d58-51306c4fcf50 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:41.418428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcee43-8357-437d-9d58-51306c4fcf50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:41.418846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcee43-8357-437d-9d58-51306c4fcf50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:41.420451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dbdcee43-8357-437d-9d58-51306c4fcf50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:41.478780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:41.539907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcee43-8357-437d-9d58-51306c4fcf50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:50:41.541453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcee43-8357-437d-9d58-51306c4fcf50 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:50:41.561837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 497/988] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:50:44.051609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dccb26-61de-430d-886d-1cd418f57a86 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:44.052826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dccb26-61de-430d-886d-1cd418f57a86 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:44.052826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dccb26-61de-430d-886d-1cd418f57a86 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:44.054073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 492/989] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:50:44.059375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3934-c519-474a-83db-8137567994e4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:44.059798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3934-c519-474a-83db-8137567994e4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:44.059965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3934-c519-474a-83db-8137567994e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:44.142031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cbbf3934-c519-474a-83db-8137567994e4 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:50:44.143260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cbbf3934-c519-474a-83db-8137567994e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:44.245440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 498/990] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:50:44.530736 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dccb26-61de-430d-886d-1cd418f57a86 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:50:44.532292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-13dccb26-61de-430d-886d-1cd418f57a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:44.635645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dccb26-61de-430d-886d-1cd418f57a86 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:50:44.708530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:44.710651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166f3fa-7880-4318-bb4f-14017f23a52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:50:44.711246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166f3fa-7880-4318-bb4f-14017f23a52e service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:44.711533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166f3fa-7880-4318-bb4f-14017f23a52e service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:44.711999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166f3fa-7880-4318-bb4f-14017f23a52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:44.713980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9166f3fa-7880-4318-bb4f-14017f23a52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:44.824506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166f3fa-7880-4318-bb4f-14017f23a52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:50:44.825969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166f3fa-7880-4318-bb4f-14017f23a52e service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:50:44.845149 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 493/991] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:50:47.297319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0cbfb-1f92-4f06-b546-e1ea7b439239 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:47.297855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0cbfb-1f92-4f06-b546-e1ea7b439239 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:47.297855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0cbfb-1f92-4f06-b546-e1ea7b439239 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:47.299173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 499/992] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:50:47.305009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668aa5-03c1-4b5e-9d29-62843b872598 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:47.305429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668aa5-03c1-4b5e-9d29-62843b872598 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:47.305593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668aa5-03c1-4b5e-9d29-62843b872598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:47.372979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ad668aa5-03c1-4b5e-9d29-62843b872598 None None] MFA Rules not processed for user `317d8f3194da47098daad34218067fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:50:47.374243 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ad668aa5-03c1-4b5e-9d29-62843b872598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:47.426841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:47.472679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 494/993] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:50:47.757517 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0cbfb-1f92-4f06-b546-e1ea7b439239 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:50:47.759112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-beb0cbfb-1f92-4f06-b546-e1ea7b439239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:47.768874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:47.866783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0cbfb-1f92-4f06-b546-e1ea7b439239 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:50:47.940470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee905cd-da12-469a-b8fb-fd76baee9246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:50:47.941079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee905cd-da12-469a-b8fb-fd76baee9246 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:47.941434 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee905cd-da12-469a-b8fb-fd76baee9246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:47.941606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee905cd-da12-469a-b8fb-fd76baee9246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:47.943483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0ee905cd-da12-469a-b8fb-fd76baee9246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:48.005955 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:48.053405 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee905cd-da12-469a-b8fb-fd76baee9246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:50:48.054855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee905cd-da12-469a-b8fb-fd76baee9246 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:50:48.072439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 500/994] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:50:50.747557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ddd41-4396-45a2-b203-24deface139d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:50.748131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ddd41-4396-45a2-b203-24deface139d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:50.748131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ddd41-4396-45a2-b203-24deface139d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:50.749434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 495/995] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:50:50.755126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb12c6-b966-4788-be40-ca4ec2757da0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:50.756025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb12c6-b966-4788-be40-ca4ec2757da0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:50.756025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb12c6-b966-4788-be40-ca4ec2757da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:50.822260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4ceb12c6-b966-4788-be40-ca4ec2757da0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:50:50.823479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4ceb12c6-b966-4788-be40-ca4ec2757da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:50.919255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 501/996] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:50:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:50:51.200740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ddd41-4396-45a2-b203-24deface139d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:50:51.202273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8e1ddd41-4396-45a2-b203-24deface139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:51.303735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ddd41-4396-45a2-b203-24deface139d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:50:51.376427 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ad65-b496-4ef7-9ef4-44f9dd541cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:50:51.377017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ad65-b496-4ef7-9ef4-44f9dd541cdd service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:51.377291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ad65-b496-4ef7-9ef4-44f9dd541cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:51.377560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ad65-b496-4ef7-9ef4-44f9dd541cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:51.379181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4622ad65-b496-4ef7-9ef4-44f9dd541cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:51.386949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:51.487521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622ad65-b496-4ef7-9ef4-44f9dd541cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:50:51.488887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622ad65-b496-4ef7-9ef4-44f9dd541cdd service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:50:51.508441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 496/997] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:50:54.303429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57fd26-449a-40d4-88e8-e26ec3b247bc None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:54.303934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57fd26-449a-40d4-88e8-e26ec3b247bc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:54.303934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57fd26-449a-40d4-88e8-e26ec3b247bc None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:54.305395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 502/998] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:50:54.310653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d6e08-bab0-4969-b5ef-7607c70dc096 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:54.311073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d6e08-bab0-4969-b5ef-7607c70dc096 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:54.311229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d6e08-bab0-4969-b5ef-7607c70dc096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:54.385597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1f7d6e08-bab0-4969-b5ef-7607c70dc096 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:50:54.386863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1f7d6e08-bab0-4969-b5ef-7607c70dc096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:54.448610 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:54.490922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 497/999] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:50:54.777099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57fd26-449a-40d4-88e8-e26ec3b247bc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:50:54.778699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3a57fd26-449a-40d4-88e8-e26ec3b247bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:54.799066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:54.885684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57fd26-449a-40d4-88e8-e26ec3b247bc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:50:54.964845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24abc-2c48-4a2f-bb2c-5893b0f6f0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:50:54.965451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24abc-2c48-4a2f-bb2c-5893b0f6f0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:54.965730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24abc-2c48-4a2f-bb2c-5893b0f6f0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:54.966005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24abc-2c48-4a2f-bb2c-5893b0f6f0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:54.967650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-40f24abc-2c48-4a2f-bb2c-5893b0f6f0e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:55.041665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:55.080221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24abc-2c48-4a2f-bb2c-5893b0f6f0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:50:55.081636 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24abc-2c48-4a2f-bb2c-5893b0f6f0e7 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:50:55.100600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 503/1000] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:50:57.315272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2e3c9-ef66-4d40-b9bd-9dd52e3c6502 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:57.315803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2e3c9-ef66-4d40-b9bd-9dd52e3c6502 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:57.315803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2e3c9-ef66-4d40-b9bd-9dd52e3c6502 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:57.317292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 498/1001] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:50:57.322568 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba921e-edef-422b-b684-acb530b67602 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:57.322999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba921e-edef-422b-b684-acb530b67602 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:57.323257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba921e-edef-422b-b684-acb530b67602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:57.391661 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2cba921e-edef-422b-b684-acb530b67602 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:50:57.392882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2cba921e-edef-422b-b684-acb530b67602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:57.502489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 504/1002] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:50:57.781797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2e3c9-ef66-4d40-b9bd-9dd52e3c6502 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:50:57.783441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4dc2e3c9-ef66-4d40-b9bd-9dd52e3c6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:57.890033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2e3c9-ef66-4d40-b9bd-9dd52e3c6502 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:50:57.966009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bbb8e-90d9-482e-8f75-a3ee755b248f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:50:57.966657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bbb8e-90d9-482e-8f75-a3ee755b248f service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:50:57.966944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bbb8e-90d9-482e-8f75-a3ee755b248f service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:50:57.967216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bbb8e-90d9-482e-8f75-a3ee755b248f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:50:57.968824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cd3bbb8e-90d9-482e-8f75-a3ee755b248f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:50:57.986285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:50:58.080864 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bbb8e-90d9-482e-8f75-a3ee755b248f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:50:58.082751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bbb8e-90d9-482e-8f75-a3ee755b248f service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:50:58.101112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 499/1003] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:00.336976 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6827e7f-2fd4-4e48-b31c-27bdebb78e11 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:00.337532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6827e7f-2fd4-4e48-b31c-27bdebb78e11 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:00.337532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6827e7f-2fd4-4e48-b31c-27bdebb78e11 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:00.338816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 505/1004] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:00.343943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f01bb-b78e-4ba8-a132-5f1e06781832 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:00.344352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f01bb-b78e-4ba8-a132-5f1e06781832 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:00.344500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f01bb-b78e-4ba8-a132-5f1e06781832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:00.415254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-be0f01bb-b78e-4ba8-a132-5f1e06781832 None None] MFA Rules not processed for user `317d8f3194da47098daad34218067fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:00.416454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-be0f01bb-b78e-4ba8-a132-5f1e06781832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:00.481190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:00.514192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 500/1005] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:00.794732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6827e7f-2fd4-4e48-b31c-27bdebb78e11 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:00.796300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6827e7f-2fd4-4e48-b31c-27bdebb78e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:00.829460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:00.906410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6827e7f-2fd4-4e48-b31c-27bdebb78e11 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:00.983015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26070d6-5176-49cf-82b7-f3f44ecf0b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:00.983547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26070d6-5176-49cf-82b7-f3f44ecf0b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:00.983825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26070d6-5176-49cf-82b7-f3f44ecf0b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:00.984097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26070d6-5176-49cf-82b7-f3f44ecf0b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:00.985701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d26070d6-5176-49cf-82b7-f3f44ecf0b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:01.065200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:01.098232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26070d6-5176-49cf-82b7-f3f44ecf0b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:01.099617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26070d6-5176-49cf-82b7-f3f44ecf0b04 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:01.118119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 506/1006] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:03.497920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763447bc-3ea4-4249-80fb-dabd3b6d0e40 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:03.498504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763447bc-3ea4-4249-80fb-dabd3b6d0e40 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:03.498706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763447bc-3ea4-4249-80fb-dabd3b6d0e40 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:03.500207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 501/1007] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:03.505568 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ac03c-374a-4039-bf26-f435d252a6e9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:03.506008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ac03c-374a-4039-bf26-f435d252a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:03.506123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ac03c-374a-4039-bf26-f435d252a6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:03.572515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-035ac03c-374a-4039-bf26-f435d252a6e9 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:03.573727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-035ac03c-374a-4039-bf26-f435d252a6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:03.669512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 507/1008] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:03.967184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1445c1-0dcf-4cb4-9783-a46e6545b170 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:03.967471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1445c1-0dcf-4cb4-9783-a46e6545b170 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:03.967745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1445c1-0dcf-4cb4-9783-a46e6545b170 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:03.969089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 502/1009] 10.222.0.27 () {54 vars in 964 bytes} [Mon Oct 10 16:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:03.975351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93947-bd61-475d-9b85-58a54975d68b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:03.975642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93947-bd61-475d-9b85-58a54975d68b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:03.975916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93947-bd61-475d-9b85-58a54975d68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:04.021529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:04.052837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-04f93947-bd61-475d-9b85-58a54975d68b None None] MFA Rules not processed for user `b3d805106909465abd09c0daf5ecc1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:04.054030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-04f93947-bd61-475d-9b85-58a54975d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:04.130124 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 508/1010] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Oct 10 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:04.139085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1445c1-0dcf-4cb4-9783-a46e6545b170 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:04.140617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cf1445c1-0dcf-4cb4-9783-a46e6545b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:04.242047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1445c1-0dcf-4cb4-9783-a46e6545b170 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:04.315125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1bc93-76fa-48c8-aafb-3a4732c8affe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:04.315716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1bc93-76fa-48c8-aafb-3a4732c8affe service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:04.315997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1bc93-76fa-48c8-aafb-3a4732c8affe service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:04.316865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1bc93-76fa-48c8-aafb-3a4732c8affe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:04.318458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-76f1bc93-76fa-48c8-aafb-3a4732c8affe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:04.345056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:04.428615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1bc93-76fa-48c8-aafb-3a4732c8affe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:04.430030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1bc93-76fa-48c8-aafb-3a4732c8affe service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:04.447991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 503/1011] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:06.914863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739245-60b6-4ed7-abf3-493452563fa6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:06.915350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739245-60b6-4ed7-abf3-493452563fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:06.915444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739245-60b6-4ed7-abf3-493452563fa6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:06.916824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 509/1012] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:06.922104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587a6fb-9293-470a-8be2-82042b4d364d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:06.922505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587a6fb-9293-470a-8be2-82042b4d364d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:06.922693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587a6fb-9293-470a-8be2-82042b4d364d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:06.989610 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f587a6fb-9293-470a-8be2-82042b4d364d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:06.990838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f587a6fb-9293-470a-8be2-82042b4d364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:07.066865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:07.088996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 504/1013] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:07.377890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34739245-60b6-4ed7-abf3-493452563fa6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:07.380238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-34739245-60b6-4ed7-abf3-493452563fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:07.483875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34739245-60b6-4ed7-abf3-493452563fa6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:07.514313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:07.560335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f240d-b2d0-4f2c-b939-685f3eba6a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:07.560943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f240d-b2d0-4f2c-b939-685f3eba6a5f service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:07.561224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f240d-b2d0-4f2c-b939-685f3eba6a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:07.561496 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f240d-b2d0-4f2c-b939-685f3eba6a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:07.563122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3a3f240d-b2d0-4f2c-b939-685f3eba6a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:07.671617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f240d-b2d0-4f2c-b939-685f3eba6a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:07.673057 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f240d-b2d0-4f2c-b939-685f3eba6a5f service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:07.691814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 510/1014] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:10.553477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61439b-e462-46e0-85e4-b34972e96d20 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:10.554038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61439b-e462-46e0-85e4-b34972e96d20 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:10.554038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61439b-e462-46e0-85e4-b34972e96d20 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:10.555401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 505/1015] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:10.560389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45534d-a39c-4661-80cb-86a5e37db19a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:10.560785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45534d-a39c-4661-80cb-86a5e37db19a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:10.560964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45534d-a39c-4661-80cb-86a5e37db19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:10.630372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9c45534d-a39c-4661-80cb-86a5e37db19a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:10.631624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9c45534d-a39c-4661-80cb-86a5e37db19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:10.640120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:10.730925 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 511/1016] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:11.015653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61439b-e462-46e0-85e4-b34972e96d20 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:11.017255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5e61439b-e462-46e0-85e4-b34972e96d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:11.118834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61439b-e462-46e0-85e4-b34972e96d20 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:11.193042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a7b12-fa86-4d36-ab15-e5820d20f782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:11.193565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7b12-fa86-4d36-ab15-e5820d20f782 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:11.193838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7b12-fa86-4d36-ab15-e5820d20f782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:11.194104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a7b12-fa86-4d36-ab15-e5820d20f782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:11.195751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d02a7b12-fa86-4d36-ab15-e5820d20f782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:11.230242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:11.302348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a7b12-fa86-4d36-ab15-e5820d20f782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:11.303794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a7b12-fa86-4d36-ab15-e5820d20f782 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:11.323426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 506/1017] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:15.519643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af343741-8793-43a6-833b-71dd8d11e894 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:15.520161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af343741-8793-43a6-833b-71dd8d11e894 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:15.520275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af343741-8793-43a6-833b-71dd8d11e894 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:15.521548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 512/1018] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:15.527034 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835ce7d-74ea-4b50-adef-d944810c0153 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:15.527418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835ce7d-74ea-4b50-adef-d944810c0153 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:15.527723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835ce7d-74ea-4b50-adef-d944810c0153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:15.593995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-3835ce7d-74ea-4b50-adef-d944810c0153 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:15.595101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3835ce7d-74ea-4b50-adef-d944810c0153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:15.684991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:15.696952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 507/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:15.979695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af343741-8793-43a6-833b-71dd8d11e894 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:15.981307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-af343741-8793-43a6-833b-71dd8d11e894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:16.089379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af343741-8793-43a6-833b-71dd8d11e894 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:16.128703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:16.166813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150c016-f33f-4261-886b-c0ff75cd1232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:16.167333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c016-f33f-4261-886b-c0ff75cd1232 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:16.167607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c016-f33f-4261-886b-c0ff75cd1232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:16.167875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c016-f33f-4261-886b-c0ff75cd1232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:16.169462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7150c016-f33f-4261-886b-c0ff75cd1232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:16.281956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150c016-f33f-4261-886b-c0ff75cd1232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:16.283406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150c016-f33f-4261-886b-c0ff75cd1232 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:16.302244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 513/1020] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:19.073342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fde2d-6834-48c4-9484-852589e8625b None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:19.073847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fde2d-6834-48c4-9484-852589e8625b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:19.073847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fde2d-6834-48c4-9484-852589e8625b None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:19.075277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 508/1021] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:19.080426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb031-5b48-4448-ae3f-0db7c77f3422 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:19.080852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb031-5b48-4448-ae3f-0db7c77f3422 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:19.081498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb031-5b48-4448-ae3f-0db7c77f3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:19.148547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b6ceb031-5b48-4448-ae3f-0db7c77f3422 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:19.149739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b6ceb031-5b48-4448-ae3f-0db7c77f3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:19.168241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:19.246635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 514/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:19.527878 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fde2d-6834-48c4-9484-852589e8625b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:19.529550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ac0fde2d-6834-48c4-9484-852589e8625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:19.638824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fde2d-6834-48c4-9484-852589e8625b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:19.716798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb503e6c-51e5-40ff-9b92-1266d27f6f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:19.717421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb503e6c-51e5-40ff-9b92-1266d27f6f3b service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:19.717702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb503e6c-51e5-40ff-9b92-1266d27f6f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:19.717977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb503e6c-51e5-40ff-9b92-1266d27f6f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:19.719722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-eb503e6c-51e5-40ff-9b92-1266d27f6f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:19.765351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:19.836105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb503e6c-51e5-40ff-9b92-1266d27f6f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:19.837459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb503e6c-51e5-40ff-9b92-1266d27f6f3b service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:19.855917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 509/1023] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:23.979629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910aa31-2f4e-43aa-a51b-4dab61e58f27 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:23.980073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910aa31-2f4e-43aa-a51b-4dab61e58f27 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:23.980186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910aa31-2f4e-43aa-a51b-4dab61e58f27 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:23.987986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f9ac-9f70-42c5-bbf2-99af535f1e20 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:23.987986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f9ac-9f70-42c5-bbf2-99af535f1e20 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:23.988569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f9ac-9f70-42c5-bbf2-99af535f1e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:23.990662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 515/1024] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:24.069955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9509f9ac-9f70-42c5-bbf2-99af535f1e20 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:24.071433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9509f9ac-9f70-42c5-bbf2-99af535f1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:24.185524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:24.187975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 510/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:51:24.474105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910aa31-2f4e-43aa-a51b-4dab61e58f27 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:24.475711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e910aa31-2f4e-43aa-a51b-4dab61e58f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:24.582473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910aa31-2f4e-43aa-a51b-4dab61e58f27 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:24.631560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:24.657259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be04cea-933f-41a0-8641-e172ab1944ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:24.657860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be04cea-933f-41a0-8641-e172ab1944ed service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:24.658137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be04cea-933f-41a0-8641-e172ab1944ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:24.658410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be04cea-933f-41a0-8641-e172ab1944ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:24.660329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3be04cea-933f-41a0-8641-e172ab1944ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:24.769486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be04cea-933f-41a0-8641-e172ab1944ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:24.770932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be04cea-933f-41a0-8641-e172ab1944ed service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:24.788400 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 516/1026] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:29.713128 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3df8c8-1edc-4d6a-8a1f-8d3f95b811c4 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:29.714072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3df8c8-1edc-4d6a-8a1f-8d3f95b811c4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:29.714672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3df8c8-1edc-4d6a-8a1f-8d3f95b811c4 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:29.716452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 511/1027] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 16:51:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:29.723043 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd01b1-3a2c-4246-9aab-f5cf7f825049 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:29.724496 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd01b1-3a2c-4246-9aab-f5cf7f825049 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:29.724994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd01b1-3a2c-4246-9aab-f5cf7f825049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:29.895077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a8fd01b1-3a2c-4246-9aab-f5cf7f825049 None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:29.896627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a8fd01b1-3a2c-4246-9aab-f5cf7f825049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:29.917253 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:30.044064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 517/1028] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:34.202913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e0b2-3bc5-460b-b962-7740a276bb34 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:34.203432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e0b2-3bc5-460b-b962-7740a276bb34 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:34.203432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e0b2-3bc5-460b-b962-7740a276bb34 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:34.204687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 512/1029] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 16:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:34.210779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5733-40ac-43f0-9fb3-abb186127adf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:34.211224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5733-40ac-43f0-9fb3-abb186127adf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:34.211333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5733-40ac-43f0-9fb3-abb186127adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:34.294575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-935e5733-40ac-43f0-9fb3-abb186127adf None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:34.296009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-935e5733-40ac-43f0-9fb3-abb186127adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:34.374261 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:34.415802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 518/1030] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:35.757663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a090be-0db9-4c3e-a32c-443db7cdaeae None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:35.758241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a090be-0db9-4c3e-a32c-443db7cdaeae None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:35.758241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a090be-0db9-4c3e-a32c-443db7cdaeae None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:35.759561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 513/1031] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 16:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:35.764615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc6d6-e2c3-47ef-a648-42d1dae83c9f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:35.765044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc6d6-e2c3-47ef-a648-42d1dae83c9f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:35.765316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc6d6-e2c3-47ef-a648-42d1dae83c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:35.846944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8f2dc6d6-e2c3-47ef-a648-42d1dae83c9f None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:35.848163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8f2dc6d6-e2c3-47ef-a648-42d1dae83c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:35.960084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 519/1032] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:39.476731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87fb4-b335-4451-88f7-9fc57dc5408f None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:39.477227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87fb4-b335-4451-88f7-9fc57dc5408f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:39.477227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87fb4-b335-4451-88f7-9fc57dc5408f None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:39.479412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 514/1033] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:39.486473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b195a-554e-4860-a627-80ca218d6dfd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:39.487104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b195a-554e-4860-a627-80ca218d6dfd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:39.487491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b195a-554e-4860-a627-80ca218d6dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:39.528236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:39.570755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2a3b195a-554e-4860-a627-80ca218d6dfd None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:39.572146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2a3b195a-554e-4860-a627-80ca218d6dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:39.683354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 520/1034] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:39.980532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724d05-cdfd-4ecc-a76a-6f7b7b9ea9ba None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:39.981024 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724d05-cdfd-4ecc-a76a-6f7b7b9ea9ba None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:39.981447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724d05-cdfd-4ecc-a76a-6f7b7b9ea9ba None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:39.983221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 515/1035] 10.222.0.27 () {54 vars in 961 bytes} [Mon Oct 10 16:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:39.996687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05509064-9510-4986-a4f8-dae5f8fffaef None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:39.997187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05509064-9510-4986-a4f8-dae5f8fffaef None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:39.997821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05509064-9510-4986-a4f8-dae5f8fffaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:40.093545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-05509064-9510-4986-a4f8-dae5f8fffaef None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:40.094948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-05509064-9510-4986-a4f8-dae5f8fffaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:40.148998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:40.224620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 521/1036] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Oct 10 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:51:40.232192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec724d05-cdfd-4ecc-a76a-6f7b7b9ea9ba None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:40.233853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ec724d05-cdfd-4ecc-a76a-6f7b7b9ea9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:40.396350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec724d05-cdfd-4ecc-a76a-6f7b7b9ea9ba None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:40.476436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:40.519488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712c92f-9842-4c4d-bae8-7dd9638910c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:40.520110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c92f-9842-4c4d-bae8-7dd9638910c2 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:40.520364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c92f-9842-4c4d-bae8-7dd9638910c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:40.520640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c92f-9842-4c4d-bae8-7dd9638910c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:40.522247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a712c92f-9842-4c4d-bae8-7dd9638910c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:40.624801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712c92f-9842-4c4d-bae8-7dd9638910c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:40.626948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712c92f-9842-4c4d-bae8-7dd9638910c2 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:40.649460 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 516/1037] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:43.066396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866cc2e-c966-4dd2-a277-a5305589ac53 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:43.067181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866cc2e-c966-4dd2-a277-a5305589ac53 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:43.067181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866cc2e-c966-4dd2-a277-a5305589ac53 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:43.072412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 522/1038] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:43.073684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a14a-fe56-4936-8fe4-9050a5eceb1f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:43.074149 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a14a-fe56-4936-8fe4-9050a5eceb1f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:43.074149 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a14a-fe56-4936-8fe4-9050a5eceb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:43.154735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4315a14a-fe56-4936-8fe4-9050a5eceb1f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:43.156068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4315a14a-fe56-4936-8fe4-9050a5eceb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:43.195596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:43.262562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 517/1039] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:43.560479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866cc2e-c966-4dd2-a277-a5305589ac53 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:43.562011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8866cc2e-c966-4dd2-a277-a5305589ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:43.741064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866cc2e-c966-4dd2-a277-a5305589ac53 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:43.752531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:43.874484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb5908-71f7-4426-8f8f-5fd5e65d6dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:43.875126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5908-71f7-4426-8f8f-5fd5e65d6dd4 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:43.875404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5908-71f7-4426-8f8f-5fd5e65d6dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:43.875675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5908-71f7-4426-8f8f-5fd5e65d6dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:43.877857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fcfb5908-71f7-4426-8f8f-5fd5e65d6dd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:43.975274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb5908-71f7-4426-8f8f-5fd5e65d6dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:43.976884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb5908-71f7-4426-8f8f-5fd5e65d6dd4 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:43.995630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 523/1040] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:46.499786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f08e5-7a76-4ec7-b9ad-d4c0ff84230c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:46.500308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f08e5-7a76-4ec7-b9ad-d4c0ff84230c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:46.500308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f08e5-7a76-4ec7-b9ad-d4c0ff84230c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:46.501754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 518/1041] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:46.507454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4c19f-64fd-495d-a12e-10942390a16e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:46.507937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4c19f-64fd-495d-a12e-10942390a16e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:46.508046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4c19f-64fd-495d-a12e-10942390a16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:46.524788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:46.577955 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-55d4c19f-64fd-495d-a12e-10942390a16e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:46.579793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-55d4c19f-64fd-495d-a12e-10942390a16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:46.687173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 524/1042] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:46.978249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2818b5-ccab-4b2b-a938-5ddcada7b727 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:46.978688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2818b5-ccab-4b2b-a938-5ddcada7b727 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:46.979063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2818b5-ccab-4b2b-a938-5ddcada7b727 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:46.980672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 519/1043] 10.222.0.27 () {54 vars in 961 bytes} [Mon Oct 10 16:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:46.986827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28c6b9-aa54-4bb9-9a6c-c9786f3881ac None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:46.987305 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28c6b9-aa54-4bb9-9a6c-c9786f3881ac None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:46.987687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28c6b9-aa54-4bb9-9a6c-c9786f3881ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:47.068752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4c28c6b9-aa54-4bb9-9a6c-c9786f3881ac None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:47.070035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4c28c6b9-aa54-4bb9-9a6c-c9786f3881ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:47.108016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:47.196864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 525/1044] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Oct 10 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:47.205313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2818b5-ccab-4b2b-a938-5ddcada7b727 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:47.206955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5f2818b5-ccab-4b2b-a938-5ddcada7b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:47.366774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2818b5-ccab-4b2b-a938-5ddcada7b727 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:47.390222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:47.500667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641ee1d-d3fc-4732-a8fe-d46aee6b857e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:47.502318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ee1d-d3fc-4732-a8fe-d46aee6b857e service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:47.502779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ee1d-d3fc-4732-a8fe-d46aee6b857e service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:47.503254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ee1d-d3fc-4732-a8fe-d46aee6b857e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:47.505252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a641ee1d-d3fc-4732-a8fe-d46aee6b857e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:47.625283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641ee1d-d3fc-4732-a8fe-d46aee6b857e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:47.627448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641ee1d-d3fc-4732-a8fe-d46aee6b857e service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:47.647267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 520/1045] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:51:47.690953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6575c-fc49-4b50-9cf8-cbc43b75a85d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:47.691503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6575c-fc49-4b50-9cf8-cbc43b75a85d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:47.691678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6575c-fc49-4b50-9cf8-cbc43b75a85d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:47.693162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 526/1046] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:47.699015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687e02-0225-480b-8e44-c4507e0d9769 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:47.699212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687e02-0225-480b-8e44-c4507e0d9769 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:47.699420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687e02-0225-480b-8e44-c4507e0d9769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:47.733795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:47.779229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6c687e02-0225-480b-8e44-c4507e0d9769 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:47.780927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6c687e02-0225-480b-8e44-c4507e0d9769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:47.924224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 521/1047] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:48.267183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be53ac-48b4-4ed1-9af3-56836def3ac5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:48.267183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be53ac-48b4-4ed1-9af3-56836def3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:48.268127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be53ac-48b4-4ed1-9af3-56836def3ac5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:48.268838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 527/1048] 10.222.0.27 () {54 vars in 963 bytes} [Mon Oct 10 16:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:48.273503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14683c-dc51-4879-8682-14d62c48f3cc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:48.273788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14683c-dc51-4879-8682-14d62c48f3cc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:48.274062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14683c-dc51-4879-8682-14d62c48f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:48.355730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5a14683c-dc51-4879-8682-14d62c48f3cc None None] MFA Rules not processed for user `3dc38841128043d0bd618275c77bbf5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:48.356967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5a14683c-dc51-4879-8682-14d62c48f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:48.411472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:48.441763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 522/1049] 10.222.0.27 () {58 vars in 1060 bytes} [Mon Oct 10 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:48.449124 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be53ac-48b4-4ed1-9af3-56836def3ac5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:48.450775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c2be53ac-48b4-4ed1-9af3-56836def3ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:48.566139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be53ac-48b4-4ed1-9af3-56836def3ac5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:48.617502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:48.648975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb9f4f-0831-4624-a6fa-bd9878c1c24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:48.649666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9f4f-0831-4624-a6fa-bd9878c1c24d service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:48.650014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9f4f-0831-4624-a6fa-bd9878c1c24d service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:48.650355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9f4f-0831-4624-a6fa-bd9878c1c24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:48.652243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2ecb9f4f-0831-4624-a6fa-bd9878c1c24d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:48.785429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb9f4f-0831-4624-a6fa-bd9878c1c24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:48.786938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb9f4f-0831-4624-a6fa-bd9878c1c24d service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:48.805966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 528/1050] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:49.901781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ee66-9fa5-426c-a9af-90bbd185e881 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:49.902284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ee66-9fa5-426c-a9af-90bbd185e881 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:49.902400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ee66-9fa5-426c-a9af-90bbd185e881 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:49.903690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 523/1051] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:49.909267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf004-515e-4015-a188-be0510570a87 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:49.909662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf004-515e-4015-a188-be0510570a87 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:49.909813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf004-515e-4015-a188-be0510570a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:49.977437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4b1bf004-515e-4015-a188-be0510570a87 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:49.978682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4b1bf004-515e-4015-a188-be0510570a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:49.999687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:50.082820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 529/1052] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:50.385254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0ee66-9fa5-426c-a9af-90bbd185e881 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:50.386846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-89a0ee66-9fa5-426c-a9af-90bbd185e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:50.542080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0ee66-9fa5-426c-a9af-90bbd185e881 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:50.597221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:50.663974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca204-bb83-4666-817c-0f3f54b213a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:50.664589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca204-bb83-4666-817c-0f3f54b213a3 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:50.664866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca204-bb83-4666-817c-0f3f54b213a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:50.665139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca204-bb83-4666-817c-0f3f54b213a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:50.666768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f53ca204-bb83-4666-817c-0f3f54b213a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:50.767958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca204-bb83-4666-817c-0f3f54b213a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:50.769557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca204-bb83-4666-817c-0f3f54b213a3 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:50.788609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 524/1053] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:53.019346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63288-8e95-4b9f-84be-8306e28cba69 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:53.019880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63288-8e95-4b9f-84be-8306e28cba69 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:53.019880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63288-8e95-4b9f-84be-8306e28cba69 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:53.021247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 530/1054] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:53.026774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9a8d-a6ae-4238-832c-501c0453bc48 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:53.027205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9a8d-a6ae-4238-832c-501c0453bc48 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:53.027300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9a8d-a6ae-4238-832c-501c0453bc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:53.095842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e36f9a8d-a6ae-4238-832c-501c0453bc48 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:53.097057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e36f9a8d-a6ae-4238-832c-501c0453bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:53.105387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:53.207482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 525/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:53.496362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63288-8e95-4b9f-84be-8306e28cba69 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:53.497910 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ccc63288-8e95-4b9f-84be-8306e28cba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:53.665785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63288-8e95-4b9f-84be-8306e28cba69 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:53.671387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:53.789425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0192c-d594-412b-aa5e-efc43d11e9d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:53.790072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0192c-d594-412b-aa5e-efc43d11e9d3 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:53.790450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0192c-d594-412b-aa5e-efc43d11e9d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:53.790855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0192c-d594-412b-aa5e-efc43d11e9d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:53.792594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-add0192c-d594-412b-aa5e-efc43d11e9d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:53.896192 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0192c-d594-412b-aa5e-efc43d11e9d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:53.897905 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0192c-d594-412b-aa5e-efc43d11e9d3 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:53.919790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 531/1056] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:51:56.151164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e52e6-68a2-4030-aa3b-1964d123a94b None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:56.151647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e52e6-68a2-4030-aa3b-1964d123a94b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:56.151858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e52e6-68a2-4030-aa3b-1964d123a94b None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:56.153752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 526/1057] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:56.158977 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f6e1-15fd-4c97-bb06-afe92435568b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:56.159420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f6e1-15fd-4c97-bb06-afe92435568b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:56.159583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f6e1-15fd-4c97-bb06-afe92435568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:56.170880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:56.234304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d4d1f6e1-15fd-4c97-bb06-afe92435568b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:56.236046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4d1f6e1-15fd-4c97-bb06-afe92435568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:56.359052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 532/1058] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:56.649395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e52e6-68a2-4030-aa3b-1964d123a94b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:56.650966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6c2e52e6-68a2-4030-aa3b-1964d123a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:56.802399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:56.813555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e52e6-68a2-4030-aa3b-1964d123a94b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:51:56.929839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128b564-7990-40ec-8ab2-61066f3d67b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:51:56.930441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128b564-7990-40ec-8ab2-61066f3d67b9 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:56.930745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128b564-7990-40ec-8ab2-61066f3d67b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:56.931029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128b564-7990-40ec-8ab2-61066f3d67b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:56.932600 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d128b564-7990-40ec-8ab2-61066f3d67b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:57.026488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128b564-7990-40ec-8ab2-61066f3d67b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:51:57.028127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128b564-7990-40ec-8ab2-61066f3d67b9 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:51:57.038311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:51:57.048829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 527/1059] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:51:59.357358 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d3daf-eed9-4011-8fac-903db36241b7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:59.357880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d3daf-eed9-4011-8fac-903db36241b7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:59.358094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d3daf-eed9-4011-8fac-903db36241b7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:59.359954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 533/1060] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:51:59.366902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66bbf-ed34-4660-8393-624bd938691b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:51:59.367337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66bbf-ed34-4660-8393-624bd938691b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:51:59.367433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66bbf-ed34-4660-8393-624bd938691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:51:59.450513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-11a66bbf-ed34-4660-8393-624bd938691b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:51:59.451801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-11a66bbf-ed34-4660-8393-624bd938691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:59.561558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 528/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:51:59.849047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d3daf-eed9-4011-8fac-903db36241b7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:51:59.850661 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2d9d3daf-eed9-4011-8fac-903db36241b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:51:59.952247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:00.024974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d3daf-eed9-4011-8fac-903db36241b7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:00.155056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20389f-00ee-4470-969a-9171da26e670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:00.155891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20389f-00ee-4470-969a-9171da26e670 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:00.156246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20389f-00ee-4470-969a-9171da26e670 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:00.156906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20389f-00ee-4470-969a-9171da26e670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:00.159348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7c20389f-00ee-4470-969a-9171da26e670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:00.226235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:00.273609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20389f-00ee-4470-969a-9171da26e670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:00.275230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20389f-00ee-4470-969a-9171da26e670 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:00.293119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 534/1062] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:02.466209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c2fc-9ccd-49dd-b131-bd712306d933 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:02.466861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c2fc-9ccd-49dd-b131-bd712306d933 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:02.466861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c2fc-9ccd-49dd-b131-bd712306d933 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:02.468129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 529/1063] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:02.474207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0385f-5d4d-4faf-bbf2-e376afd49aec None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:02.474666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0385f-5d4d-4faf-bbf2-e376afd49aec None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:02.474798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0385f-5d4d-4faf-bbf2-e376afd49aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:02.540943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e5a0385f-5d4d-4faf-bbf2-e376afd49aec None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:02.542141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e5a0385f-5d4d-4faf-bbf2-e376afd49aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:02.640579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 535/1064] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:02.930487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330c2fc-9ccd-49dd-b131-bd712306d933 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:02.932136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4330c2fc-9ccd-49dd-b131-bd712306d933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:03.014047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:03.084001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330c2fc-9ccd-49dd-b131-bd712306d933 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:03.199078 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef0803-68b2-4d16-8093-88cd41fa1879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:03.199599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef0803-68b2-4d16-8093-88cd41fa1879 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:03.199872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef0803-68b2-4d16-8093-88cd41fa1879 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:03.200140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef0803-68b2-4d16-8093-88cd41fa1879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:03.201714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-08ef0803-68b2-4d16-8093-88cd41fa1879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:03.241506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:03.294878 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef0803-68b2-4d16-8093-88cd41fa1879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:03.296602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef0803-68b2-4d16-8093-88cd41fa1879 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:03.315070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 530/1065] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:04.124432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c6244-830c-43c7-9725-fe116a54130a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:04.125538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c6244-830c-43c7-9725-fe116a54130a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:04.125538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c6244-830c-43c7-9725-fe116a54130a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:04.126883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 536/1066] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:04.132064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaebf1-ca1e-4744-ae69-58a5c7361029 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:04.132486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaebf1-ca1e-4744-ae69-58a5c7361029 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:04.132590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaebf1-ca1e-4744-ae69-58a5c7361029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:04.202933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-dabaebf1-ca1e-4744-ae69-58a5c7361029 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:04.204358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dabaebf1-ca1e-4744-ae69-58a5c7361029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:04.307757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 531/1067] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:04.607891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e65e8-80ca-448f-b318-9d0f6ca908da None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:04.608177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e65e8-80ca-448f-b318-9d0f6ca908da None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:04.608453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e65e8-80ca-448f-b318-9d0f6ca908da None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:04.610286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 537/1068] 10.222.0.27 () {54 vars in 962 bytes} [Mon Oct 10 16:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:04.615830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ee49-94a6-4fea-bf74-725e521bd0ae None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:04.616118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ee49-94a6-4fea-bf74-725e521bd0ae None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:04.616407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ee49-94a6-4fea-bf74-725e521bd0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:04.633203 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:04.693740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-26c4ee49-94a6-4fea-bf74-725e521bd0ae None None] MFA Rules not processed for user `ede14ff816494505b20faba615bc5026`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:04.694972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-26c4ee49-94a6-4fea-bf74-725e521bd0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:04.771025 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 532/1069] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Oct 10 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:04.780249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e65e8-80ca-448f-b318-9d0f6ca908da None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:04.782355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-213e65e8-80ca-448f-b318-9d0f6ca908da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:04.813542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:04.886534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e65e8-80ca-448f-b318-9d0f6ca908da None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:04.962641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec811fa7-e4d3-4e29-b2c1-bab1fca06729 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ede14ff816494505b20faba615bc5026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:04.963242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec811fa7-e4d3-4e29-b2c1-bab1fca06729 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:04.963548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec811fa7-e4d3-4e29-b2c1-bab1fca06729 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:04.963826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec811fa7-e4d3-4e29-b2c1-bab1fca06729 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:04.965422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ec811fa7-e4d3-4e29-b2c1-bab1fca06729 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:05.050081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:05.082503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec811fa7-e4d3-4e29-b2c1-bab1fca06729 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:05.083962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec811fa7-e4d3-4e29-b2c1-bab1fca06729 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:05.103101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 538/1070] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:05.521319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953f00-c767-4ea5-8e3c-5d231d563974 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:05.521859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953f00-c767-4ea5-8e3c-5d231d563974 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:05.521859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953f00-c767-4ea5-8e3c-5d231d563974 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:05.523207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 533/1071] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:05.528948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638b77-d2c0-4353-8b64-e1b52dd896aa None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:05.529375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638b77-d2c0-4353-8b64-e1b52dd896aa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:05.529502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638b77-d2c0-4353-8b64-e1b52dd896aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:05.606768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a2638b77-d2c0-4353-8b64-e1b52dd896aa None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:05.608056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a2638b77-d2c0-4353-8b64-e1b52dd896aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:05.719386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 539/1072] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:05.872234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f8715-d800-416b-981b-b629d4986161 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:05.872517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f8715-d800-416b-981b-b629d4986161 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:05.872786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f8715-d800-416b-981b-b629d4986161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:05.940166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a30f8715-d800-416b-981b-b629d4986161 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:05.941354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a30f8715-d800-416b-981b-b629d4986161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:05.996641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:06.013128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638b77-d2c0-4353-8b64-e1b52dd896aa None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:06.014364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a2638b77-d2c0-4353-8b64-e1b52dd896aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:06.030079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 534/1073] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:06.057078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:06.074961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed716-22ef-4cdd-a12c-3dc84839e584 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:06.075273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed716-22ef-4cdd-a12c-3dc84839e584 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:06.075554 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed716-22ef-4cdd-a12c-3dc84839e584 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:06.076952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 535/1074] 10.222.0.27 () {54 vars in 943 bytes} [Mon Oct 10 16:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:52:06.083518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13d1c5-a31d-442a-abb6-4ea075643795 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:06.083876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13d1c5-a31d-442a-abb6-4ea075643795 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:06.084207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13d1c5-a31d-442a-abb6-4ea075643795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:06.136098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638b77-d2c0-4353-8b64-e1b52dd896aa None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:06.161553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-af13d1c5-a31d-442a-abb6-4ea075643795 None None] MFA Rules not processed for user `7ee9a6828d334114bb3a7ae391960bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:06.162785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-af13d1c5-a31d-442a-abb6-4ea075643795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:06.257889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2675eb1-3b15-4e42-91e3-45a1bb04f539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:06.258510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2675eb1-3b15-4e42-91e3-45a1bb04f539 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:06.258824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2675eb1-3b15-4e42-91e3-45a1bb04f539 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:06.259097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2675eb1-3b15-4e42-91e3-45a1bb04f539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:06.260720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c2675eb1-3b15-4e42-91e3-45a1bb04f539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:06.274104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 536/1075] 10.222.0.27 () {58 vars in 1040 bytes} [Mon Oct 10 16:52:06 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:06.284446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13d1c5-a31d-442a-abb6-4ea075643795 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:06.294198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13d1c5-a31d-442a-abb6-4ea075643795 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:06.296710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:06.323763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:06.361668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2675eb1-3b15-4e42-91e3-45a1bb04f539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:06.363316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2675eb1-3b15-4e42-91e3-45a1bb04f539 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:06.384573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 540/1076] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:52:06.417042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded026db-efb3-4019-b8e6-4e04bc7d4d22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:06.417665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded026db-efb3-4019-b8e6-4e04bc7d4d22 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:06.417946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded026db-efb3-4019-b8e6-4e04bc7d4d22 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:06.418217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded026db-efb3-4019-b8e6-4e04bc7d4d22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:06.419959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ded026db-efb3-4019-b8e6-4e04bc7d4d22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:06.533993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded026db-efb3-4019-b8e6-4e04bc7d4d22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:06.535564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded026db-efb3-4019-b8e6-4e04bc7d4d22 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:06.547380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 537/1077] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 16:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 16:52:08.619687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db8f9-0ce0-4f84-b9a7-b505a41443c0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:08.620278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db8f9-0ce0-4f84-b9a7-b505a41443c0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:08.620278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db8f9-0ce0-4f84-b9a7-b505a41443c0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:08.621653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 541/1078] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:08.627020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286781e-9489-4851-b950-7d6840f96aab None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:08.627447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286781e-9489-4851-b950-7d6840f96aab None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:08.627635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286781e-9489-4851-b950-7d6840f96aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:08.705051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2286781e-9489-4851-b950-7d6840f96aab None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:08.706366 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2286781e-9489-4851-b950-7d6840f96aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:08.713384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:08.819672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 538/1079] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:09.119389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db8f9-0ce0-4f84-b9a7-b505a41443c0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:09.120961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cd7db8f9-0ce0-4f84-b9a7-b505a41443c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:09.291634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db8f9-0ce0-4f84-b9a7-b505a41443c0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:09.306258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:09.448444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ade162-3657-4e11-8d00-a065e1e924f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:09.449063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade162-3657-4e11-8d00-a065e1e924f5 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:09.449343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade162-3657-4e11-8d00-a065e1e924f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:09.449614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade162-3657-4e11-8d00-a065e1e924f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:09.451361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-50ade162-3657-4e11-8d00-a065e1e924f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:09.669698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ade162-3657-4e11-8d00-a065e1e924f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:09.672573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ade162-3657-4e11-8d00-a065e1e924f5 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:09.696907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 542/1080] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:11.942964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386061-348e-4f0e-b451-fea2289edb78 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:11.943532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386061-348e-4f0e-b451-fea2289edb78 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:11.943532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386061-348e-4f0e-b451-fea2289edb78 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:11.944843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 539/1081] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:11.950168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd48695-b88b-4aec-aa94-aef6bc4f85da None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:11.950619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd48695-b88b-4aec-aa94-aef6bc4f85da None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:11.950736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd48695-b88b-4aec-aa94-aef6bc4f85da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:11.971257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:12.025534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bdd48695-b88b-4aec-aa94-aef6bc4f85da None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:12.026983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bdd48695-b88b-4aec-aa94-aef6bc4f85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:12.135103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 543/1082] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:12.441044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f386061-348e-4f0e-b451-fea2289edb78 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:12.442585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7f386061-348e-4f0e-b451-fea2289edb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:12.591529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:12.605191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f386061-348e-4f0e-b451-fea2289edb78 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:12.727038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b18d3-e51a-4d95-a5a9-bd8a21e36367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:12.727633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b18d3-e51a-4d95-a5a9-bd8a21e36367 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:12.727907 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b18d3-e51a-4d95-a5a9-bd8a21e36367 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:12.728172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b18d3-e51a-4d95-a5a9-bd8a21e36367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:12.729765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0b7b18d3-e51a-4d95-a5a9-bd8a21e36367 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:12.831278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b18d3-e51a-4d95-a5a9-bd8a21e36367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:12.833007 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b18d3-e51a-4d95-a5a9-bd8a21e36367 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:12.845120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:12.854173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 540/1083] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:15.097616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495a5a2-2187-4a9c-b671-d0fb8b4899df None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:15.098542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495a5a2-2187-4a9c-b671-d0fb8b4899df None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:15.098829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495a5a2-2187-4a9c-b671-d0fb8b4899df None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:15.100182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 544/1084] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:15.105491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac56d-83ef-4d2f-96e4-6f93a9a2d097 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:15.105914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac56d-83ef-4d2f-96e4-6f93a9a2d097 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:15.106086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac56d-83ef-4d2f-96e4-6f93a9a2d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:15.181636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b9dac56d-83ef-4d2f-96e4-6f93a9a2d097 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:15.182929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b9dac56d-83ef-4d2f-96e4-6f93a9a2d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:15.289591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 541/1085] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:15.581915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495a5a2-2187-4a9c-b671-d0fb8b4899df None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:15.583504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c495a5a2-2187-4a9c-b671-d0fb8b4899df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:15.689089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:15.756888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495a5a2-2187-4a9c-b671-d0fb8b4899df None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:15.887603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4108c-670b-4157-88fb-131d123fd5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:15.888223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4108c-670b-4157-88fb-131d123fd5d4 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:15.888565 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4108c-670b-4157-88fb-131d123fd5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:15.888844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4108c-670b-4157-88fb-131d123fd5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:15.890795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67a4108c-670b-4157-88fb-131d123fd5d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:15.957258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:15.991703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4108c-670b-4157-88fb-131d123fd5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:15.993576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4108c-670b-4157-88fb-131d123fd5d4 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:16.023931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 545/1086] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:25.287983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=67 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:26.014696 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=20 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:29.336688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1223301-1b8c-491d-93b8-9dd0b25672d0 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:29.337246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1223301-1b8c-491d-93b8-9dd0b25672d0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:29.337246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1223301-1b8c-491d-93b8-9dd0b25672d0 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:29.338509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 542/1087] 10.222.0.27 () {54 vars in 918 bytes} [Mon Oct 10 16:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:29.343478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba6af-dfb4-4e30-b6c9-0d45d03179b2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:29.343920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba6af-dfb4-4e30-b6c9-0d45d03179b2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:29.344025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba6af-dfb4-4e30-b6c9-0d45d03179b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:29.422066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-12dba6af-dfb4-4e30-b6c9-0d45d03179b2 None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:29.423317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-12dba6af-dfb4-4e30-b6c9-0d45d03179b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:29.528831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 546/1088] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Oct 10 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:29.543308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21ce5-6ad3-48d6-8470-0fc8a3c6ba78 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:29.543589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21ce5-6ad3-48d6-8470-0fc8a3c6ba78 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:29.543859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21ce5-6ad3-48d6-8470-0fc8a3c6ba78 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:29.545854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 543/1089] 10.222.0.27 () {54 vars in 918 bytes} [Mon Oct 10 16:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:29.550360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ed5c4-60f9-49a0-a496-9b4021652eab None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:29.550678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ed5c4-60f9-49a0-a496-9b4021652eab None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:29.550958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ed5c4-60f9-49a0-a496-9b4021652eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:29.623750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:29.626603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-636ed5c4-60f9-49a0-a496-9b4021652eab None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:29.628390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-636ed5c4-60f9-49a0-a496-9b4021652eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:29.745508 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 547/1090] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Oct 10 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:32.328346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afd071-52b8-4d90-9cb0-0df153a00403 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:32.328877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afd071-52b8-4d90-9cb0-0df153a00403 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:32.328877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afd071-52b8-4d90-9cb0-0df153a00403 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:32.330150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 544/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:52:32.335701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a07d-bb5f-4443-a4a8-942ed3184ce3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:32.336095 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a07d-bb5f-4443-a4a8-942ed3184ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:32.336282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a07d-bb5f-4443-a4a8-942ed3184ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:32.409781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fd69a07d-bb5f-4443-a4a8-942ed3184ce3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:32.411017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fd69a07d-bb5f-4443-a4a8-942ed3184ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:32.466335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:32.509382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 548/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:32.798544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afd071-52b8-4d90-9cb0-0df153a00403 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:32.800199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b0afd071-52b8-4d90-9cb0-0df153a00403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:32.944574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afd071-52b8-4d90-9cb0-0df153a00403 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:33.022356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:33.062871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95205782-e1bb-4fe9-8594-e6f69348d252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:33.063405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205782-e1bb-4fe9-8594-e6f69348d252 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:33.063680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205782-e1bb-4fe9-8594-e6f69348d252 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:33.063949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205782-e1bb-4fe9-8594-e6f69348d252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:33.065534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-95205782-e1bb-4fe9-8594-e6f69348d252 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:33.152659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95205782-e1bb-4fe9-8594-e6f69348d252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:33.154750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95205782-e1bb-4fe9-8594-e6f69348d252 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:33.172723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 545/1093] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:34.334680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dc73-0101-48ed-a9c1-29f9404d959a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:34.335196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dc73-0101-48ed-a9c1-29f9404d959a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:34.335469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dc73-0101-48ed-a9c1-29f9404d959a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:34.336821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 549/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:34.344114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2af2-c690-4af3-a1a9-bd46a7b76310 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:34.344524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2af2-c690-4af3-a1a9-bd46a7b76310 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:34.344663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2af2-c690-4af3-a1a9-bd46a7b76310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:34.423539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1f5a2af2-c690-4af3-a1a9-bd46a7b76310 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:34.424725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1f5a2af2-c690-4af3-a1a9-bd46a7b76310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:34.450415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:34.520211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 546/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:34.671219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2dc73-0101-48ed-a9c1-29f9404d959a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:34.672757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fea2dc73-0101-48ed-a9c1-29f9404d959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:34.817341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2dc73-0101-48ed-a9c1-29f9404d959a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:34.858243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:34.932075 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d5787-4856-4ce9-8ab9-4482ee7c0d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:34.932609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5787-4856-4ce9-8ab9-4482ee7c0d99 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:34.932881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5787-4856-4ce9-8ab9-4482ee7c0d99 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:34.933145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5787-4856-4ce9-8ab9-4482ee7c0d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:34.934770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-043d5787-4856-4ce9-8ab9-4482ee7c0d99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:35.025396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d5787-4856-4ce9-8ab9-4482ee7c0d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:35.027052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d5787-4856-4ce9-8ab9-4482ee7c0d99 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:35.046834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 550/1096] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:36.190695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fda8b-ddb5-41a9-8a9c-949fd68050a0 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:36.191231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fda8b-ddb5-41a9-8a9c-949fd68050a0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:36.191231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fda8b-ddb5-41a9-8a9c-949fd68050a0 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:36.192503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 547/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:36.198727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c38d-7acf-43bd-a17e-1abb746e95ec None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:36.199179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c38d-7acf-43bd-a17e-1abb746e95ec None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:36.199287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c38d-7acf-43bd-a17e-1abb746e95ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:36.255189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:36.277551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9d22c38d-7acf-43bd-a17e-1abb746e95ec None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:36.278770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9d22c38d-7acf-43bd-a17e-1abb746e95ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:36.377348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 551/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:36.528760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fda8b-ddb5-41a9-8a9c-949fd68050a0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:36.530404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f70fda8b-ddb5-41a9-8a9c-949fd68050a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:36.672658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fda8b-ddb5-41a9-8a9c-949fd68050a0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:36.684749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:36.784428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdcbb9-060e-4903-ae16-ec722947dcd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:36.784941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcbb9-060e-4903-ae16-ec722947dcd9 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:36.785214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcbb9-060e-4903-ae16-ec722947dcd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:36.785481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcbb9-060e-4903-ae16-ec722947dcd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:36.787081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-30fdcbb9-060e-4903-ae16-ec722947dcd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:36.875844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdcbb9-060e-4903-ae16-ec722947dcd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:36.877419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdcbb9-060e-4903-ae16-ec722947dcd9 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:36.896013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 548/1099] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:38.006164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c86eb-9974-477d-9c45-1ab18d954899 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:38.006682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c86eb-9974-477d-9c45-1ab18d954899 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:38.006788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c86eb-9974-477d-9c45-1ab18d954899 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:38.008126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 552/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:38.015112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb67c99-12fd-41ec-a417-7414bf5118cb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:38.015554 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb67c99-12fd-41ec-a417-7414bf5118cb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:38.015689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb67c99-12fd-41ec-a417-7414bf5118cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:38.036423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:38.092909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5cb67c99-12fd-41ec-a417-7414bf5118cb None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:38.094104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5cb67c99-12fd-41ec-a417-7414bf5118cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:38.188405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 549/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:38.338894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c86eb-9974-477d-9c45-1ab18d954899 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:38.340410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5b5c86eb-9974-477d-9c45-1ab18d954899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:38.453412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:38.490390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c86eb-9974-477d-9c45-1ab18d954899 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:38.603460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740a200-0dd9-487d-b3d4-02983e745e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:38.604057 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a200-0dd9-487d-b3d4-02983e745e8a service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:38.604329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a200-0dd9-487d-b3d4-02983e745e8a service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:38.604590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740a200-0dd9-487d-b3d4-02983e745e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:38.606180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4740a200-0dd9-487d-b3d4-02983e745e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:38.681498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:38.695292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740a200-0dd9-487d-b3d4-02983e745e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:38.696875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740a200-0dd9-487d-b3d4-02983e745e8a service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:38.714976 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 553/1102] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:39.813166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ed6b-8f4c-4df1-986f-5151b94dea72 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:39.813686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ed6b-8f4c-4df1-986f-5151b94dea72 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:39.813686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ed6b-8f4c-4df1-986f-5151b94dea72 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:39.815003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 550/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:39.821015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45df1-efc6-4d34-86ae-3f6c27bb1dbc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:39.821449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45df1-efc6-4d34-86ae-3f6c27bb1dbc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:39.821567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45df1-efc6-4d34-86ae-3f6c27bb1dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:39.900349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7dd45df1-efc6-4d34-86ae-3f6c27bb1dbc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:39.901556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7dd45df1-efc6-4d34-86ae-3f6c27bb1dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:40.001410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 554/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:40.147801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6ed6b-8f4c-4df1-986f-5151b94dea72 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:40.149361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-95c6ed6b-8f4c-4df1-986f-5151b94dea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:40.231649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:40.292857 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6ed6b-8f4c-4df1-986f-5151b94dea72 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:40.410338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f475da-f3a0-4846-9e3c-95da536eaf6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:40.410883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f475da-f3a0-4846-9e3c-95da536eaf6b service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:40.411159 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f475da-f3a0-4846-9e3c-95da536eaf6b service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:40.411429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f475da-f3a0-4846-9e3c-95da536eaf6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:40.413033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-57f475da-f3a0-4846-9e3c-95da536eaf6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:40.461812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:40.504306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f475da-f3a0-4846-9e3c-95da536eaf6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:40.505986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f475da-f3a0-4846-9e3c-95da536eaf6b service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:40.525033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 551/1105] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:41.579243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3623a5-d230-42b3-b994-5ed98488bef6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:41.579787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3623a5-d230-42b3-b994-5ed98488bef6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:41.579787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3623a5-d230-42b3-b994-5ed98488bef6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:41.581123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 555/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:41.587361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34557-51d2-4ae8-8396-7562cdac4dad None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:41.587809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34557-51d2-4ae8-8396-7562cdac4dad None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:41.587909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34557-51d2-4ae8-8396-7562cdac4dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:41.662300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-52d34557-51d2-4ae8-8396-7562cdac4dad None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:41.663510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-52d34557-51d2-4ae8-8396-7562cdac4dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:41.758466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 552/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:41.909200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3623a5-d230-42b3-b994-5ed98488bef6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:41.910748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7b3623a5-d230-42b3-b994-5ed98488bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:41.959806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:42.057282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3623a5-d230-42b3-b994-5ed98488bef6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:42.169999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022c42b-0434-4139-831c-0f5abc7de328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:42.170640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c42b-0434-4139-831c-0f5abc7de328 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:42.170915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c42b-0434-4139-831c-0f5abc7de328 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:42.171182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c42b-0434-4139-831c-0f5abc7de328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:42.172775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7022c42b-0434-4139-831c-0f5abc7de328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:42.179671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:42.265175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022c42b-0434-4139-831c-0f5abc7de328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:42.266780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022c42b-0434-4139-831c-0f5abc7de328 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:42.288730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 556/1108] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:43.345387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc2bf2-273b-4cff-b7e7-41de1918b307 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:43.345972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc2bf2-273b-4cff-b7e7-41de1918b307 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:43.345972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc2bf2-273b-4cff-b7e7-41de1918b307 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:43.347231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 553/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:43.353357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ca10-d57d-4a58-b127-22d1bf1743a1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:43.353780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ca10-d57d-4a58-b127-22d1bf1743a1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:43.353906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ca10-d57d-4a58-b127-22d1bf1743a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:43.429211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9167ca10-d57d-4a58-b127-22d1bf1743a1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:43.430396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9167ca10-d57d-4a58-b127-22d1bf1743a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:43.498251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:43.528111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 557/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:43.676355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc2bf2-273b-4cff-b7e7-41de1918b307 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:43.677877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-badc2bf2-273b-4cff-b7e7-41de1918b307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:43.695585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:43.825067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc2bf2-273b-4cff-b7e7-41de1918b307 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:43.913036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:43.940089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e127d77-0503-4be6-ba35-dac2d30249a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:43.940622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e127d77-0503-4be6-ba35-dac2d30249a1 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:43.940902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e127d77-0503-4be6-ba35-dac2d30249a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:43.941179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e127d77-0503-4be6-ba35-dac2d30249a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:43.942827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8e127d77-0503-4be6-ba35-dac2d30249a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:44.032658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e127d77-0503-4be6-ba35-dac2d30249a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:44.034250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e127d77-0503-4be6-ba35-dac2d30249a1 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:44.052326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 554/1111] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:45.107749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04c6c-02ca-497b-8f42-6df03c2cfece None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:45.108319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04c6c-02ca-497b-8f42-6df03c2cfece None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:45.108319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04c6c-02ca-497b-8f42-6df03c2cfece None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:45.109650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 558/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:45.116054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bec24-680d-4e5a-8bc8-1ea132cd0784 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:45.116462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bec24-680d-4e5a-8bc8-1ea132cd0784 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:45.116632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bec24-680d-4e5a-8bc8-1ea132cd0784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:45.192060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d26bec24-680d-4e5a-8bc8-1ea132cd0784 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:45.193167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d26bec24-680d-4e5a-8bc8-1ea132cd0784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:45.234409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:45.287828 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 555/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:52:45.449852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04c6c-02ca-497b-8f42-6df03c2cfece None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:45.451409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-35c04c6c-02ca-497b-8f42-6df03c2cfece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:45.602317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04c6c-02ca-497b-8f42-6df03c2cfece None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:45.659099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:45.717955 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a769-2766-4edb-b287-c3694ee1b490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:45.718484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a769-2766-4edb-b287-c3694ee1b490 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:45.718796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a769-2766-4edb-b287-c3694ee1b490 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:45.719070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a769-2766-4edb-b287-c3694ee1b490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:45.720683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3d83a769-2766-4edb-b287-c3694ee1b490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:45.811322 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a769-2766-4edb-b287-c3694ee1b490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:45.812923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a769-2766-4edb-b287-c3694ee1b490 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:45.831451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 559/1114] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:46.882817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec081-b05d-45f8-b748-4a0839419649 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:46.883395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec081-b05d-45f8-b748-4a0839419649 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:46.883395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec081-b05d-45f8-b748-4a0839419649 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:46.884697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 556/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:46.891268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5c02-6024-40a7-b6b9-2e18ae593f95 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:46.891754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5c02-6024-40a7-b6b9-2e18ae593f95 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:46.891905 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5c02-6024-40a7-b6b9-2e18ae593f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:46.968140 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0e9b5c02-6024-40a7-b6b9-2e18ae593f95 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:46.969336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0e9b5c02-6024-40a7-b6b9-2e18ae593f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:46.971370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:47.067404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 560/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:47.218726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ec081-b05d-45f8-b748-4a0839419649 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:47.220295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-656ec081-b05d-45f8-b748-4a0839419649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:47.364588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ec081-b05d-45f8-b748-4a0839419649 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:47.391594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:47.477682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769a7f4-a526-4088-88a2-702ab3dea7b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:47.478201 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769a7f4-a526-4088-88a2-702ab3dea7b2 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:47.478474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769a7f4-a526-4088-88a2-702ab3dea7b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:47.478765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769a7f4-a526-4088-88a2-702ab3dea7b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:47.480346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a769a7f4-a526-4088-88a2-702ab3dea7b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:47.569680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769a7f4-a526-4088-88a2-702ab3dea7b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:47.571318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769a7f4-a526-4088-88a2-702ab3dea7b2 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:47.589331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 557/1117] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:49.666736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9164c-e107-4e7e-9ecb-84a0e27053db None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:49.667283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9164c-e107-4e7e-9ecb-84a0e27053db None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:49.667283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9164c-e107-4e7e-9ecb-84a0e27053db None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:49.668653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 561/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:49.674432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e331c-71bf-465d-b634-a2ab1b535da8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:49.674902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e331c-71bf-465d-b634-a2ab1b535da8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:49.675015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e331c-71bf-465d-b634-a2ab1b535da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:49.716749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:49.742581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-df7e331c-71bf-465d-b634-a2ab1b535da8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:49.743777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-df7e331c-71bf-465d-b634-a2ab1b535da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:49.839059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 558/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:50.126566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9164c-e107-4e7e-9ecb-84a0e27053db None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:50.128125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-32a9164c-e107-4e7e-9ecb-84a0e27053db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:50.230542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9164c-e107-4e7e-9ecb-84a0e27053db None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:50.263181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:50.305556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cdda5-86eb-43c0-aec0-5bd9869f21ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:50.306162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cdda5-86eb-43c0-aec0-5bd9869f21ff service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:50.306441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cdda5-86eb-43c0-aec0-5bd9869f21ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:50.306743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cdda5-86eb-43c0-aec0-5bd9869f21ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:50.308346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-969cdda5-86eb-43c0-aec0-5bd9869f21ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:50.418973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cdda5-86eb-43c0-aec0-5bd9869f21ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:50.421068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cdda5-86eb-43c0-aec0-5bd9869f21ff service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:50.438871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 562/1120] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:52.803304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068bab-6ccb-459e-a05a-370a2723d96e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:52.803888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068bab-6ccb-459e-a05a-370a2723d96e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:52.803888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068bab-6ccb-459e-a05a-370a2723d96e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:52.805200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 559/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:52.810789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f4abb-c895-423a-bde2-8a34063fee6d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:52.811218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f4abb-c895-423a-bde2-8a34063fee6d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:52.811329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f4abb-c895-423a-bde2-8a34063fee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:52.877172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-da7f4abb-c895-423a-bde2-8a34063fee6d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:52.878371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-da7f4abb-c895-423a-bde2-8a34063fee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:52.892231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:52.976110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 563/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:53.260449 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068bab-6ccb-459e-a05a-370a2723d96e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:53.262047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6d068bab-6ccb-459e-a05a-370a2723d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:53.364887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068bab-6ccb-459e-a05a-370a2723d96e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:53.378339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:53.439308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeba7a-01d9-47dd-92dc-771e4ad88251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:53.439909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba7a-01d9-47dd-92dc-771e4ad88251 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:53.440187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba7a-01d9-47dd-92dc-771e4ad88251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:53.440457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba7a-01d9-47dd-92dc-771e4ad88251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:53.442090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8edeba7a-01d9-47dd-92dc-771e4ad88251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:53.550881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeba7a-01d9-47dd-92dc-771e4ad88251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:53.552266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeba7a-01d9-47dd-92dc-771e4ad88251 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:53.569799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 560/1123] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:56.048802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0097-4663-418f-b53d-441445f96f70 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:56.049312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0097-4663-418f-b53d-441445f96f70 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:56.049411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0097-4663-418f-b53d-441445f96f70 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:56.050719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 564/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:56.056021 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b0d4-cd3c-4931-becd-1c4c41a395d2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:56.056399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b0d4-cd3c-4931-becd-1c4c41a395d2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:56.056562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b0d4-cd3c-4931-becd-1c4c41a395d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:56.105156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:56.124062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2504b0d4-cd3c-4931-becd-1c4c41a395d2 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:56.125252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2504b0d4-cd3c-4931-becd-1c4c41a395d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:56.219134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 561/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:56.506950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d0097-4663-418f-b53d-441445f96f70 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:56.508538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d58d0097-4663-418f-b53d-441445f96f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:56.614034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d0097-4663-418f-b53d-441445f96f70 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:56.654880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:56.688472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891525e-374a-4757-9c98-612179dafc17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:56.689069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891525e-374a-4757-9c98-612179dafc17 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:56.689349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891525e-374a-4757-9c98-612179dafc17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:56.689623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891525e-374a-4757-9c98-612179dafc17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:56.691266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5891525e-374a-4757-9c98-612179dafc17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:56.802034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891525e-374a-4757-9c98-612179dafc17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:56.803419 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891525e-374a-4757-9c98-612179dafc17 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:56.821635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 565/1126] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:52:59.071088 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a457060-2c5f-4309-a9c2-d1cdba6816f8 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:59.071648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a457060-2c5f-4309-a9c2-d1cdba6816f8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:59.071648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a457060-2c5f-4309-a9c2-d1cdba6816f8 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:59.073013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 562/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:52:59.078394 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84baf9-7a67-405d-a71a-f1e398f8b791 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:59.078873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84baf9-7a67-405d-a71a-f1e398f8b791 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:59.078982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84baf9-7a67-405d-a71a-f1e398f8b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:59.144623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-da84baf9-7a67-405d-a71a-f1e398f8b791 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:52:59.145750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-da84baf9-7a67-405d-a71a-f1e398f8b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:59.168234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:59.245853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 566/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:52:59.527239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a457060-2c5f-4309-a9c2-d1cdba6816f8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:52:59.529383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9a457060-2c5f-4309-a9c2-d1cdba6816f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:59.630733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a457060-2c5f-4309-a9c2-d1cdba6816f8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:52:59.651604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:52:59.705121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f68b2-35bc-4961-95c2-c69cba577bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:52:59.705723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f68b2-35bc-4961-95c2-c69cba577bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:52:59.706000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f68b2-35bc-4961-95c2-c69cba577bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:52:59.706272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f68b2-35bc-4961-95c2-c69cba577bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:52:59.707897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8b9f68b2-35bc-4961-95c2-c69cba577bb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:52:59.815698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f68b2-35bc-4961-95c2-c69cba577bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:52:59.817059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f68b2-35bc-4961-95c2-c69cba577bb0 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:52:59.835550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 563/1129] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:02.062906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c8651-0228-4d4f-9abe-354c7ebafe48 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:02.063430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c8651-0228-4d4f-9abe-354c7ebafe48 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:02.063533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c8651-0228-4d4f-9abe-354c7ebafe48 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:02.064810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 567/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:02.070209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d9b0-6bb6-48fc-bff2-c713c2d92f14 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:02.070623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d9b0-6bb6-48fc-bff2-c713c2d92f14 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:02.070786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d9b0-6bb6-48fc-bff2-c713c2d92f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:02.134073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:02.136793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bd17d9b0-6bb6-48fc-bff2-c713c2d92f14 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:02.139247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bd17d9b0-6bb6-48fc-bff2-c713c2d92f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:02.233028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 564/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:02.527434 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c8651-0228-4d4f-9abe-354c7ebafe48 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:02.529633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-211c8651-0228-4d4f-9abe-354c7ebafe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:02.631820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c8651-0228-4d4f-9abe-354c7ebafe48 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:02.681635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:02.707365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e26ff-401b-488a-8b63-e308f7b0091f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:02.707976 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e26ff-401b-488a-8b63-e308f7b0091f service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:02.708256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e26ff-401b-488a-8b63-e308f7b0091f service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:02.708545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e26ff-401b-488a-8b63-e308f7b0091f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:02.710148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-262e26ff-401b-488a-8b63-e308f7b0091f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:02.819789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e26ff-401b-488a-8b63-e308f7b0091f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:02.821133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e26ff-401b-488a-8b63-e308f7b0091f service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:02.839945 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 568/1132] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:05.025233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf6b7-55bd-440a-8127-4ce70a17f178 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:05.025767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf6b7-55bd-440a-8127-4ce70a17f178 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:05.025767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf6b7-55bd-440a-8127-4ce70a17f178 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:05.027164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 565/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:05.032628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ad3c-fbb2-4041-ae8a-5e1ad4988c6a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:05.033037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ad3c-fbb2-4041-ae8a-5e1ad4988c6a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:05.033229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ad3c-fbb2-4041-ae8a-5e1ad4988c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:05.101017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8403ad3c-fbb2-4041-ae8a-5e1ad4988c6a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:05.102196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8403ad3c-fbb2-4041-ae8a-5e1ad4988c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:05.131891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:05.198803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 569/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:05.485629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edf6b7-55bd-440a-8127-4ce70a17f178 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:05.487278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-72edf6b7-55bd-440a-8127-4ce70a17f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:05.595357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edf6b7-55bd-440a-8127-4ce70a17f178 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:05.623645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:05.669824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4613bb-60cd-4d52-8e9e-25ecc510cb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:05.670424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4613bb-60cd-4d52-8e9e-25ecc510cb71 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:05.670732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4613bb-60cd-4d52-8e9e-25ecc510cb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:05.671006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4613bb-60cd-4d52-8e9e-25ecc510cb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:05.672617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2c4613bb-60cd-4d52-8e9e-25ecc510cb71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:05.781264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4613bb-60cd-4d52-8e9e-25ecc510cb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:05.782652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4613bb-60cd-4d52-8e9e-25ecc510cb71 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:05.800779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 566/1135] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:07.991756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5854d3-403e-4aff-8a23-8208a7258d26 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:07.992291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5854d3-403e-4aff-8a23-8208a7258d26 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:07.992291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5854d3-403e-4aff-8a23-8208a7258d26 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:07.993901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:08.000162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95d79-6c30-44f1-8138-65439864ada4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:08.000598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95d79-6c30-44f1-8138-65439864ada4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:08.000718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95d79-6c30-44f1-8138-65439864ada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:08.066360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-86a95d79-6c30-44f1-8138-65439864ada4 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:08.067641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-86a95d79-6c30-44f1-8138-65439864ada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:08.076319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:08.163094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:08.445150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5854d3-403e-4aff-8a23-8208a7258d26 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:08.446737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d5854d3-403e-4aff-8a23-8208a7258d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:08.553177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5854d3-403e-4aff-8a23-8208a7258d26 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:08.609403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:08.628131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4ec88-c101-4030-a582-f10960a29bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:08.628764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ec88-c101-4030-a582-f10960a29bba service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:08.629046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ec88-c101-4030-a582-f10960a29bba service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:08.629321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4ec88-c101-4030-a582-f10960a29bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:08.630965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46e4ec88-c101-4030-a582-f10960a29bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:08.741487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4ec88-c101-4030-a582-f10960a29bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:08.743131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4ec88-c101-4030-a582-f10960a29bba service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:08.761104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 571/1138] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:10.990242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bab6c-ee4c-40b4-aa8b-ce34bc3cfc3a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:10.990831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bab6c-ee4c-40b4-aa8b-ce34bc3cfc3a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:10.990831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bab6c-ee4c-40b4-aa8b-ce34bc3cfc3a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:10.992144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:10.997653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760782-ced4-481d-9b87-89577962cbb4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:10.998229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760782-ced4-481d-9b87-89577962cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:10.998229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760782-ced4-481d-9b87-89577962cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:11.064278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-22760782-ced4-481d-9b87-89577962cbb4 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:11.065472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22760782-ced4-481d-9b87-89577962cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:11.107795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:11.167346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:11.451515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bab6c-ee4c-40b4-aa8b-ce34bc3cfc3a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:11.452803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4f7bab6c-ee4c-40b4-aa8b-ce34bc3cfc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:11.556341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bab6c-ee4c-40b4-aa8b-ce34bc3cfc3a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:11.593747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:11.630015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c805fc9-c224-4aab-ae54-e8db4604bf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:11.630636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c805fc9-c224-4aab-ae54-e8db4604bf32 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:11.630912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c805fc9-c224-4aab-ae54-e8db4604bf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:11.631180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c805fc9-c224-4aab-ae54-e8db4604bf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:11.632761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5c805fc9-c224-4aab-ae54-e8db4604bf32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:11.738086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c805fc9-c224-4aab-ae54-e8db4604bf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:11.739455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c805fc9-c224-4aab-ae54-e8db4604bf32 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:11.758174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 569/1141] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:13.945726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5591a-06b2-4e46-b00e-d32728c905a3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:13.946232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5591a-06b2-4e46-b00e-d32728c905a3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:13.946345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5591a-06b2-4e46-b00e-d32728c905a3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:13.947683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:13.953518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2752f-5825-4bd2-833b-754d2a31fafa None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:13.953914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2752f-5825-4bd2-833b-754d2a31fafa None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:13.954075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2752f-5825-4bd2-833b-754d2a31fafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:14.020291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-3aa2752f-5825-4bd2-833b-754d2a31fafa None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:14.021477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3aa2752f-5825-4bd2-833b-754d2a31fafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:14.039980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:14.118049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:14.405782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5591a-06b2-4e46-b00e-d32728c905a3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:14.407373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7b5591a-06b2-4e46-b00e-d32728c905a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:14.515439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5591a-06b2-4e46-b00e-d32728c905a3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:14.586635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:14.593827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575ba3a-f5b7-4f26-8da2-b14bcb9b5198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:14.594430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575ba3a-f5b7-4f26-8da2-b14bcb9b5198 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:14.594735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575ba3a-f5b7-4f26-8da2-b14bcb9b5198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:14.595007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575ba3a-f5b7-4f26-8da2-b14bcb9b5198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:14.596610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c575ba3a-f5b7-4f26-8da2-b14bcb9b5198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:14.706938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575ba3a-f5b7-4f26-8da2-b14bcb9b5198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:14.708282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575ba3a-f5b7-4f26-8da2-b14bcb9b5198 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:14.726785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 574/1144] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:16.859121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e8c44-d41f-4297-8b6c-751fdb52fced None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:16.859694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e8c44-d41f-4297-8b6c-751fdb52fced None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:16.860158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e8c44-d41f-4297-8b6c-751fdb52fced None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:16.861503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:16.866951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d81be-f309-4551-9859-9ed85c1a68b0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:16.867402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d81be-f309-4551-9859-9ed85c1a68b0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:16.867523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d81be-f309-4551-9859-9ed85c1a68b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:16.933433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1c4d81be-f309-4551-9859-9ed85c1a68b0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:16.934669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1c4d81be-f309-4551-9859-9ed85c1a68b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:16.983786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:17.032272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:53:17.323188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e8c44-d41f-4297-8b6c-751fdb52fced None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:17.324731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d92e8c44-d41f-4297-8b6c-751fdb52fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:17.429280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e8c44-d41f-4297-8b6c-751fdb52fced None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:17.477475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:17.504536 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95471bc-cce2-4db3-8684-448705723a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:17.505130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95471bc-cce2-4db3-8684-448705723a5d service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:17.505404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95471bc-cce2-4db3-8684-448705723a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:17.505672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95471bc-cce2-4db3-8684-448705723a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:17.507468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e95471bc-cce2-4db3-8684-448705723a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:17.617120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95471bc-cce2-4db3-8684-448705723a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:17.618762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95471bc-cce2-4db3-8684-448705723a5d service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:17.637267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 572/1147] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:27.030820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=22 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:27.634985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=66 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:37.578417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33858-40c2-4d81-810c-4db126218788 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:37.579003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33858-40c2-4d81-810c-4db126218788 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:37.579003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33858-40c2-4d81-810c-4db126218788 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:37.580270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 576/1148] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:53:37.585574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc27ee-44f0-4bb3-8051-278dbd1b7538 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:37.585974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc27ee-44f0-4bb3-8051-278dbd1b7538 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:37.586133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc27ee-44f0-4bb3-8051-278dbd1b7538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:37.651144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-dffc27ee-44f0-4bb3-8051-278dbd1b7538 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:37.652344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dffc27ee-44f0-4bb3-8051-278dbd1b7538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:37.748225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 573/1149] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:38.053812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee99fd-1392-44c6-aa7e-507eca235632 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:38.054116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee99fd-1392-44c6-aa7e-507eca235632 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:38.054390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee99fd-1392-44c6-aa7e-507eca235632 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:38.055788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 577/1150] 10.222.0.27 () {54 vars in 962 bytes} [Mon Oct 10 16:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:38.061685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fae4-3f7d-46a3-a163-80eb944d3eac None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:38.061968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fae4-3f7d-46a3-a163-80eb944d3eac None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:38.062240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fae4-3f7d-46a3-a163-80eb944d3eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:38.137505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5f01fae4-3f7d-46a3-a163-80eb944d3eac None None] MFA Rules not processed for user `ede14ff816494505b20faba615bc5026`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:38.138855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5f01fae4-3f7d-46a3-a163-80eb944d3eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:38.159451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:38.216514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 574/1151] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Oct 10 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:38.224186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee99fd-1392-44c6-aa7e-507eca235632 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:38.225688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2bee99fd-1392-44c6-aa7e-507eca235632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:38.328105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee99fd-1392-44c6-aa7e-507eca235632 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:38.401144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd29a-1d52-4e6f-87a8-5ff33cd0d5c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ede14ff816494505b20faba615bc5026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:38.401746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd29a-1d52-4e6f-87a8-5ff33cd0d5c0 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:38.402026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd29a-1d52-4e6f-87a8-5ff33cd0d5c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:38.402300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd29a-1d52-4e6f-87a8-5ff33cd0d5c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:38.404499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eedfd29a-1d52-4e6f-87a8-5ff33cd0d5c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:38.458831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:38.516100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfd29a-1d52-4e6f-87a8-5ff33cd0d5c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:38.517521 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfd29a-1d52-4e6f-87a8-5ff33cd0d5c0 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:38.536203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 578/1152] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:40.783846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21a68-04c2-4af5-b679-905b4bf8bc1f None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:40.784437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21a68-04c2-4af5-b679-905b4bf8bc1f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:40.784437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21a68-04c2-4af5-b679-905b4bf8bc1f None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:40.785749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 575/1153] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:40.791041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092a38-1882-4148-9908-ca1d75da5950 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:40.791443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092a38-1882-4148-9908-ca1d75da5950 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:40.791592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092a38-1882-4148-9908-ca1d75da5950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:40.858491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-23092a38-1882-4148-9908-ca1d75da5950 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:40.859716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-23092a38-1882-4148-9908-ca1d75da5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:40.957474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 579/1154] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:41.231415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21a68-04c2-4af5-b679-905b4bf8bc1f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:41.233459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-79c21a68-04c2-4af5-b679-905b4bf8bc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:41.361592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21a68-04c2-4af5-b679-905b4bf8bc1f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:41.410407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:41.454593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6a772-f9e4-4ccb-89e5-e705733da55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:41.455190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a772-f9e4-4ccb-89e5-e705733da55a admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:41.455465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a772-f9e4-4ccb-89e5-e705733da55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:41.455735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a772-f9e4-4ccb-89e5-e705733da55a admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:41.456359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6a772-f9e4-4ccb-89e5-e705733da55a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:41.457450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-cdd6a772-f9e4-4ccb-89e5-e705733da55a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:53:41.457450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:53:41.457450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:53:41.458594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6a772-f9e4-4ccb-89e5-e705733da55a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:41.477688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 576/1155] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Oct 10 16:53:41 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:53:43.664772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642300-f8eb-4a81-a559-f40d3c3bd338 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:43.665382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642300-f8eb-4a81-a559-f40d3c3bd338 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:43.665382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642300-f8eb-4a81-a559-f40d3c3bd338 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:43.666712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 580/1156] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:43.672693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c83f-ecba-4bfd-a707-d2c5c65901b9 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:43.673137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c83f-ecba-4bfd-a707-d2c5c65901b9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:43.673241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c83f-ecba-4bfd-a707-d2c5c65901b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:43.738707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2834c83f-ecba-4bfd-a707-d2c5c65901b9 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:43.739916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2834c83f-ecba-4bfd-a707-d2c5c65901b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:43.835180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 577/1157] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:44.134903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642300-f8eb-4a81-a559-f40d3c3bd338 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:44.136505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0d642300-f8eb-4a81-a559-f40d3c3bd338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:44.146270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:44.305123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642300-f8eb-4a81-a559-f40d3c3bd338 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:44.386367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:44.420311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ea0dd-3e7a-4e56-83c4-6c0055fb6eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:44.420913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ea0dd-3e7a-4e56-83c4-6c0055fb6eac service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:44.421189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ea0dd-3e7a-4e56-83c4-6c0055fb6eac service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:44.421463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ea0dd-3e7a-4e56-83c4-6c0055fb6eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:44.423090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f32ea0dd-3e7a-4e56-83c4-6c0055fb6eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:44.513710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ea0dd-3e7a-4e56-83c4-6c0055fb6eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:44.515363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ea0dd-3e7a-4e56-83c4-6c0055fb6eac service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:44.534110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 581/1158] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:46.900147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bdb4-e222-4376-9a71-7923ded79135 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:46.900609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bdb4-e222-4376-9a71-7923ded79135 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:46.900725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bdb4-e222-4376-9a71-7923ded79135 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:46.902083 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 578/1159] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:46.907770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3bda-507d-4bd4-9ed3-26dbea1d385a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:46.908188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3bda-507d-4bd4-9ed3-26dbea1d385a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:46.908310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3bda-507d-4bd4-9ed3-26dbea1d385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:46.974621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fbbf3bda-507d-4bd4-9ed3-26dbea1d385a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:46.975820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fbbf3bda-507d-4bd4-9ed3-26dbea1d385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:47.022360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:47.072472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 582/1160] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:47.357137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bdb4-e222-4376-9a71-7923ded79135 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:47.358841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ec44bdb4-e222-4376-9a71-7923ded79135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:47.382169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:47.461341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bdb4-e222-4376-9a71-7923ded79135 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:47.535399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92995236-daf1-4651-ba3e-0ef700329c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:47.535989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995236-daf1-4651-ba3e-0ef700329c7a service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:47.536263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995236-daf1-4651-ba3e-0ef700329c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:47.536529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995236-daf1-4651-ba3e-0ef700329c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:47.538106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-92995236-daf1-4651-ba3e-0ef700329c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:47.611019 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:47.645785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92995236-daf1-4651-ba3e-0ef700329c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:47.647262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92995236-daf1-4651-ba3e-0ef700329c7a service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:47.664941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 579/1161] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:49.895746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa4c9b-2aa8-4095-b655-e6a550ff1493 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:49.896147 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa4c9b-2aa8-4095-b655-e6a550ff1493 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:49.896302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa4c9b-2aa8-4095-b655-e6a550ff1493 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:49.897657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 583/1162] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:49.902998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327749e-77fe-4ea3-ba67-6617096834f2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:49.903549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327749e-77fe-4ea3-ba67-6617096834f2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:49.903792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327749e-77fe-4ea3-ba67-6617096834f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:49.971344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6327749e-77fe-4ea3-ba67-6617096834f2 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:49.972550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6327749e-77fe-4ea3-ba67-6617096834f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:50.070034 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 580/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:50.370421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa4c9b-2aa8-4095-b655-e6a550ff1493 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:50.371994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-08aa4c9b-2aa8-4095-b655-e6a550ff1493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:50.477341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa4c9b-2aa8-4095-b655-e6a550ff1493 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:50.551525 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:50.553032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454eb5b-7e4a-4d13-adc4-d7dd16c48513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:50.553721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454eb5b-7e4a-4d13-adc4-d7dd16c48513 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:50.554204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454eb5b-7e4a-4d13-adc4-d7dd16c48513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:50.554670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454eb5b-7e4a-4d13-adc4-d7dd16c48513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:50.556447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3454eb5b-7e4a-4d13-adc4-d7dd16c48513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:50.668588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454eb5b-7e4a-4d13-adc4-d7dd16c48513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:50.670547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454eb5b-7e4a-4d13-adc4-d7dd16c48513 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:50.689042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 584/1164] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:52.979997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d90a4-f7bf-4f38-a741-59f93e2a0755 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:52.980571 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d90a4-f7bf-4f38-a741-59f93e2a0755 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:52.980571 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d90a4-f7bf-4f38-a741-59f93e2a0755 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:52.982303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 581/1165] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:52.987961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09247a-ac96-41e6-b446-75a8a9d66d01 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:52.988385 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09247a-ac96-41e6-b446-75a8a9d66d01 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:52.988520 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09247a-ac96-41e6-b446-75a8a9d66d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:53.054903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1f09247a-ac96-41e6-b446-75a8a9d66d01 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:53.056143 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f09247a-ac96-41e6-b446-75a8a9d66d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:53.110197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:53.155848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 585/1166] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:53:53.445257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d90a4-f7bf-4f38-a741-59f93e2a0755 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:53.446819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-309d90a4-f7bf-4f38-a741-59f93e2a0755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:53.483435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:53.552344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d90a4-f7bf-4f38-a741-59f93e2a0755 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:53.626432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1dda4-3f4d-4795-abbc-9d02d4131023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:53.627056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1dda4-3f4d-4795-abbc-9d02d4131023 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:53.627336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1dda4-3f4d-4795-abbc-9d02d4131023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:53.627609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1dda4-3f4d-4795-abbc-9d02d4131023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:53.629204 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1fb1dda4-3f4d-4795-abbc-9d02d4131023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:53.709803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:53.738489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1dda4-3f4d-4795-abbc-9d02d4131023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:53.739941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1dda4-3f4d-4795-abbc-9d02d4131023 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:53.758932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 582/1167] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:53:56.134190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eefaf-d5ab-4433-a357-790942407ef0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:56.134767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eefaf-d5ab-4433-a357-790942407ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:56.134767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eefaf-d5ab-4433-a357-790942407ef0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:56.136111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 586/1168] 10.222.0.27 () {54 vars in 927 bytes} [Mon Oct 10 16:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:53:56.141602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f721d7-998a-4b6a-af51-d88e2a135a51 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:56.142046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f721d7-998a-4b6a-af51-d88e2a135a51 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:56.142156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f721d7-998a-4b6a-af51-d88e2a135a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:56.207132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-85f721d7-998a-4b6a-af51-d88e2a135a51 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:53:56.208241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-85f721d7-998a-4b6a-af51-d88e2a135a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:56.304102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 583/1169] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Oct 10 16:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:53:56.597341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27eefaf-d5ab-4433-a357-790942407ef0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:53:56.598973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e27eefaf-d5ab-4433-a357-790942407ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:56.705118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27eefaf-d5ab-4433-a357-790942407ef0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:53:56.779775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1992748-eb33-439b-96fe-e62fe9d07118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:53:56.780369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992748-eb33-439b-96fe-e62fe9d07118 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:53:56.780648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992748-eb33-439b-96fe-e62fe9d07118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:53:56.780922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992748-eb33-439b-96fe-e62fe9d07118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:53:56.782564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a1992748-eb33-439b-96fe-e62fe9d07118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:53:56.791059 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:53:56.893332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1992748-eb33-439b-96fe-e62fe9d07118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:53:56.894807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1992748-eb33-439b-96fe-e62fe9d07118 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:53:56.912690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 587/1170] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:54:06.302665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=82 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:54:06.910356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=50 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:15.973940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3626738-783e-4096-9be9-83237d1f773c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:15.974446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3626738-783e-4096-9be9-83237d1f773c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:15.974589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3626738-783e-4096-9be9-83237d1f773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:16.048432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b3626738-783e-4096-9be9-83237d1f773c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:55:16.049615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b3626738-783e-4096-9be9-83237d1f773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:16.144113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 584/1171] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:55:16.152395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b33a2-ffec-4eff-84a1-609bb5a06db5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:16.152911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b33a2-ffec-4eff-84a1-609bb5a06db5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:16.153012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b33a2-ffec-4eff-84a1-609bb5a06db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:16.228788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a56b33a2-ffec-4eff-84a1-609bb5a06db5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:55:16.230070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a56b33a2-ffec-4eff-84a1-609bb5a06db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:16.325311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 588/1172] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:55:16.329896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3626738-783e-4096-9be9-83237d1f773c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:16.331134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b3626738-783e-4096-9be9-83237d1f773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:16.342969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3626738-783e-4096-9be9-83237d1f773c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:16.403977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:16.437987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85636-890f-411e-a574-c50875132106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:16.438617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85636-890f-411e-a574-c50875132106 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:16.438896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85636-890f-411e-a574-c50875132106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:16.439165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85636-890f-411e-a574-c50875132106 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:16.439802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85636-890f-411e-a574-c50875132106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:55:16.440104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85636-890f-411e-a574-c50875132106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:16.441113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-89b85636-890f-411e-a574-c50875132106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:55:16.441113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:55:16.441113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:55:16.441991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85636-890f-411e-a574-c50875132106 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:16.453355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 585/1173] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:55:16.461551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b33a2-ffec-4eff-84a1-609bb5a06db5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:16.471287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b33a2-ffec-4eff-84a1-609bb5a06db5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:16.533850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:16.567993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:16.568599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:16.568873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:16.569141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:16.569845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:16.570972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:55:16.570972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 10 16:55:16.570972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: Oct 10 16:55:16.572203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:16.629495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 589/1174] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:55:16 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:55:16.633704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85636-890f-411e-a574-c50875132106 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:16.635268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-89b85636-890f-411e-a574-c50875132106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:16.669728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85636-890f-411e-a574-c50875132106 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:16.760576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:16.761168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:16.762071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:16.762419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:16.763079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:16.764080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:55:16.764080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:55:16.764080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:55:16.765265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:16.805200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 586/1175] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:55:16 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:55:16.809855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:16.811431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:16.874273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1879d-4d57-4cf8-99c1-3bb6e30387d6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:16.958553 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:16.970001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:16.970640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:16.970922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:16.971194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:16.971830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:16.973446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:16.985690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 590/1176] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:55:16.989669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:16.991217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:17.003327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a94f5-f687-4d31-a21d-6f51e4635f92 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:17.028461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:17.099092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d8480-4c2a-4ab8-a4b2-05f8e5dbc70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:17.099709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8480-4c2a-4ab8-a4b2-05f8e5dbc70e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:17.099983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8480-4c2a-4ab8-a4b2-05f8e5dbc70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:17.100249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8480-4c2a-4ab8-a4b2-05f8e5dbc70e admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:17.100879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d8480-4c2a-4ab8-a4b2-05f8e5dbc70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:17.102495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d8480-4c2a-4ab8-a4b2-05f8e5dbc70e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:17.115355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 587/1177] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:55:17.119619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:17.122045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:17.156496 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f28ca-557c-44d7-9b79-1ee578b6de71 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:17.251753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c11d7a-e396-4074-84e4-a9531bcb8e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:17.252334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11d7a-e396-4074-84e4-a9531bcb8e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:17.252615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11d7a-e396-4074-84e4-a9531bcb8e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:17.252891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11d7a-e396-4074-84e4-a9531bcb8e7f admin admin] PATH_INFO: `/v3/projects/99890659dfb14bd9bfd8481927fb1e64/users/6ec757bc1ea94966aaed0a127580301a/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:17.275390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c11d7a-e396-4074-84e4-a9531bcb8e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99890659dfb14bd9bfd8481927fb1e64, user_id=6ec757bc1ea94966aaed0a127580301a, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:17.278214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c11d7a-e396-4074-84e4-a9531bcb8e7f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:17.304018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 591/1178] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:55:17 2022] PUT /identity/v3/projects/99890659dfb14bd9bfd8481927fb1e64/users/6ec757bc1ea94966aaed0a127580301a/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:55:17.316844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8a10-9e26-4d9c-891c-dc7eddbdfa88 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:17.317137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8a10-9e26-4d9c-891c-dc7eddbdfa88 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:17.317496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8a10-9e26-4d9c-891c-dc7eddbdfa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:17.374577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0d4b8a10-9e26-4d9c-891c-dc7eddbdfa88 None None] MFA Rules not processed for user `6ec757bc1ea94966aaed0a127580301a`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:55:17.375787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0d4b8a10-9e26-4d9c-891c-dc7eddbdfa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:17.451411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 588/1179] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:55:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:55:17.465651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7691722-6c9f-4acb-98c9-a0fec8b9026c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:17.465964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7691722-6c9f-4acb-98c9-a0fec8b9026c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:17.466232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7691722-6c9f-4acb-98c9-a0fec8b9026c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:17.468006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 592/1180] 10.222.0.27 () {54 vars in 963 bytes} [Mon Oct 10 16:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:55:17.472689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15189-7848-4196-9ac4-2fbe811e596e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:17.472982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15189-7848-4196-9ac4-2fbe811e596e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:17.473259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15189-7848-4196-9ac4-2fbe811e596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:17.505150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:17.550684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1da15189-7848-4196-9ac4-2fbe811e596e None None] MFA Rules not processed for user `3dc38841128043d0bd618275c77bbf5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:55:17.551888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1da15189-7848-4196-9ac4-2fbe811e596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:17.626935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 589/1181] 10.222.0.27 () {58 vars in 1060 bytes} [Mon Oct 10 16:55:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:55:17.634658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7691722-6c9f-4acb-98c9-a0fec8b9026c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:17.636186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7691722-6c9f-4acb-98c9-a0fec8b9026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:17.688260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:17.742233 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7691722-6c9f-4acb-98c9-a0fec8b9026c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:17.816038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:17.816569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:17.816850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:17.817125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:17.818756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:17.919546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:17.920979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:17.924534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:17.939171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 593/1182] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:55:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:55:17.984593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c906-c491-4e79-8493-e59fb3c9535f None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:17.984886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c906-c491-4e79-8493-e59fb3c9535f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:17.985163 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5c906-c491-4e79-8493-e59fb3c9535f None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:17.986414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 590/1183] 10.222.0.27 () {52 vars in 830 bytes} [Mon Oct 10 16:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:55:17.990044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:17.991304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:18.094701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a4caa-c3cb-4887-8d29-c198e0a50d3b service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:18.188720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:18.189360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:18.189615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:18.189894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] PATH_INFO: `/v3/users/6ec757bc1ea94966aaed0a127580301a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:18.202706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec757bc1ea94966aaed0a127580301a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:18.203728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:55:18.203728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 10 16:55:18.203728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: Oct 10 16:55:18.204951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:18.215316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:18.271856 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec757bc1ea94966aaed0a127580301a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:18.272393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec757bc1ea94966aaed0a127580301a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:18.286630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec757bc1ea94966aaed0a127580301a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:18.310136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec757bc1ea94966aaed0a127580301a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:18.310621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec757bc1ea94966aaed0a127580301a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:18.325184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 594/1184] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:55:17 2022] DELETE /identity/v3/users/6ec757bc1ea94966aaed0a127580301a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:55:18.329677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257923f-3336-417a-bbea-3d07d1d479c0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:18.330167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257923f-3336-417a-bbea-3d07d1d479c0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:18.330324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257923f-3336-417a-bbea-3d07d1d479c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:18.387900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a257923f-3336-417a-bbea-3d07d1d479c0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:55:18.389023 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a257923f-3336-417a-bbea-3d07d1d479c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:18.463187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:18.475528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 591/1185] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:55:18.485600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:18.486864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:18.589030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32d988-e69a-4c73-9323-6e5f11a4541c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:18.645129 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:18.667296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab29a8-8fd7-4586-a2a4-15696c4da3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:18.668895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab29a8-8fd7-4586-a2a4-15696c4da3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:18.669171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab29a8-8fd7-4586-a2a4-15696c4da3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:18.669438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab29a8-8fd7-4586-a2a4-15696c4da3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:18.671077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-52ab29a8-8fd7-4586-a2a4-15696c4da3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:18.780342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab29a8-8fd7-4586-a2a4-15696c4da3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:18.781774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab29a8-8fd7-4586-a2a4-15696c4da3c9 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:18.800398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 595/1186] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:55:19.119067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257923f-3336-417a-bbea-3d07d1d479c0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:55:19.120648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a257923f-3336-417a-bbea-3d07d1d479c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:55:19.132648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257923f-3336-417a-bbea-3d07d1d479c0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:55:19.235236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:55:19.235763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:55:19.236040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:55:19.236313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] PATH_INFO: `/v3/projects/99890659dfb14bd9bfd8481927fb1e64` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:55:19.246268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99890659dfb14bd9bfd8481927fb1e64)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:55:19.247326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:55:19.247326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:55:19.247326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:55:19.248514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:55:19.306490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99890659dfb14bd9bfd8481927fb1e64', 'request_id': 'req-5a78ea06-a435-491d-a0dc-11f434d1e875'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:19.320173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99890659dfb14bd9bfd8481927fb1e64', 'request_id': 'req-5a78ea06-a435-491d-a0dc-11f434d1e875'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:19.326357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99890659dfb14bd9bfd8481927fb1e64', 'request_id': 'req-5a78ea06-a435-491d-a0dc-11f434d1e875'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:19.355798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] The token cache is being invalidate because project 99890659dfb14bd9bfd8481927fb1e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:55:19.356503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:19.356634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a78ea06-a435-491d-a0dc-11f434d1e875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:55:19.357866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 592/1187] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:55:19 2022] DELETE /identity/v3/projects/99890659dfb14bd9bfd8481927fb1e64 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:55:28.798161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=62 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:55:29.353152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:56:52.494549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ccd15-0e00-46df-9e78-b659d87fde12 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:56:52.495415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ccd15-0e00-46df-9e78-b659d87fde12 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:56:52.495415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ccd15-0e00-46df-9e78-b659d87fde12 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:56:52.496678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 596/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:56:52.502090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02909d56-4ce4-49dd-ac00-823cca4e4adb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:56:52.502544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02909d56-4ce4-49dd-ac00-823cca4e4adb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:56:52.502652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02909d56-4ce4-49dd-ac00-823cca4e4adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:56:52.582927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-02909d56-4ce4-49dd-ac00-823cca4e4adb None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:56:52.584054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-02909d56-4ce4-49dd-ac00-823cca4e4adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:56:52.685551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 593/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:56:52.843196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ccd15-0e00-46df-9e78-b659d87fde12 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:56:52.845344 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ee2ccd15-0e00-46df-9e78-b659d87fde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:56:52.966781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ccd15-0e00-46df-9e78-b659d87fde12 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:56:52.972847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf9b92-c00f-49cc-8fd0-6858c9013b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:56:52.973458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf9b92-c00f-49cc-8fd0-6858c9013b45 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:56:52.973737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf9b92-c00f-49cc-8fd0-6858c9013b45 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:56:52.974011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf9b92-c00f-49cc-8fd0-6858c9013b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:56:52.982115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf9b92-c00f-49cc-8fd0-6858c9013b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:56:52.983838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf9b92-c00f-49cc-8fd0-6858c9013b45 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:56:52.993174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 597/1190] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:56:54.099970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a72b8d-febe-4bda-a983-2572fcb5e8c3 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:56:54.100530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a72b8d-febe-4bda-a983-2572fcb5e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:56:54.100636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a72b8d-febe-4bda-a983-2572fcb5e8c3 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:56:54.102097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 594/1191] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:56:54.102876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8e91-9a11-4618-9c25-7f3265cc7993 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:56:54.103307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8e91-9a11-4618-9c25-7f3265cc7993 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:56:54.103442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8e91-9a11-4618-9c25-7f3265cc7993 None None] PATH_INFO: `/v3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:56:54.104714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 598/1192] 10.222.0.44 () {54 vars in 925 bytes} [Mon Oct 10 16:56:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:56:54.108626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495883-1b9e-4c20-bb47-c77b2409373b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:56:54.108903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495883-1b9e-4c20-bb47-c77b2409373b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:56:54.109176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495883-1b9e-4c20-bb47-c77b2409373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:56:54.122996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351d557-65c9-446b-97bb-765175a62305 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:56:54.123919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351d557-65c9-446b-97bb-765175a62305 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:56:54.124443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351d557-65c9-446b-97bb-765175a62305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:56:54.130118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-79495883-1b9e-4c20-bb47-c77b2409373b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:56:54.131451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-79495883-1b9e-4c20-bb47-c77b2409373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:56:54.140545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 595/1193] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:56:54.190031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a351d557-65c9-446b-97bb-765175a62305 None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:56:54.191274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a351d557-65c9-446b-97bb-765175a62305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:56:54.258215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:56:54.263764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 599/1194] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Oct 10 16:56:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:56:54.304396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79495883-1b9e-4c20-bb47-c77b2409373b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:56:54.317358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79495883-1b9e-4c20-bb47-c77b2409373b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:56:54.322852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4196b80-e49d-4110-abc8-be398b962658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:56:54.323448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4196b80-e49d-4110-abc8-be398b962658 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:56:54.323731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4196b80-e49d-4110-abc8-be398b962658 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:56:54.324000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4196b80-e49d-4110-abc8-be398b962658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:56:54.333114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4196b80-e49d-4110-abc8-be398b962658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:56:54.334727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4196b80-e49d-4110-abc8-be398b962658 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:56:54.344448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 596/1195] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:57:03.195713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de0c20-ea29-4424-90d3-189d586d9647 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:03.196181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de0c20-ea29-4424-90d3-189d586d9647 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:03.196292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de0c20-ea29-4424-90d3-189d586d9647 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:03.197665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 600/1196] 10.222.0.27 () {54 vars in 961 bytes} [Mon Oct 10 16:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:57:03.202991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1bc88-97b3-4ca4-b035-01d3182afbbc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:03.203437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1bc88-97b3-4ca4-b035-01d3182afbbc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:03.203539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1bc88-97b3-4ca4-b035-01d3182afbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:03.223264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5de1bc88-97b3-4ca4-b035-01d3182afbbc None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:57:03.224454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5de1bc88-97b3-4ca4-b035-01d3182afbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:03.232861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 597/1197] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Oct 10 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:57:03.241166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de0c20-ea29-4424-90d3-189d586d9647 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:57:03.255115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de0c20-ea29-4424-90d3-189d586d9647 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:57:03.260160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b317e-2332-4cca-9035-d008f88d7426 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:57:03.260812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b317e-2332-4cca-9035-d008f88d7426 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:03.261089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b317e-2332-4cca-9035-d008f88d7426 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:03.261360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b317e-2332-4cca-9035-d008f88d7426 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:03.269755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b317e-2332-4cca-9035-d008f88d7426 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:57:03.271366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b317e-2332-4cca-9035-d008f88d7426 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:57:03.281296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 601/1198] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:57:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:57:05.820069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324b19-cfb4-4d29-8ada-cd4dd3df50dc None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:05.820603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324b19-cfb4-4d29-8ada-cd4dd3df50dc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:05.820603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324b19-cfb4-4d29-8ada-cd4dd3df50dc None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:05.821902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 598/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:57:05.828642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d77f5-7132-4198-b28f-c1dbc1dad52e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:05.829068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d77f5-7132-4198-b28f-c1dbc1dad52e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:05.829184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d77f5-7132-4198-b28f-c1dbc1dad52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:05.849234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-926d77f5-7132-4198-b28f-c1dbc1dad52e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:57:05.850425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-926d77f5-7132-4198-b28f-c1dbc1dad52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:05.858429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 602/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:57:06.012649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a324b19-cfb4-4d29-8ada-cd4dd3df50dc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:57:06.027657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a324b19-cfb4-4d29-8ada-cd4dd3df50dc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:57:06.033769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7aa1-f310-477a-aebe-45ebe80eddeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:57:06.034355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7aa1-f310-477a-aebe-45ebe80eddeb service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:06.034665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7aa1-f310-477a-aebe-45ebe80eddeb service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:06.034942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7aa1-f310-477a-aebe-45ebe80eddeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:06.042828 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e7aa1-f310-477a-aebe-45ebe80eddeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:57:06.044401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e7aa1-f310-477a-aebe-45ebe80eddeb service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:57:06.053750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 599/1201] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:57:07.131169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccb849-2f66-4a56-b274-efc617a8c16c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:07.131786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccb849-2f66-4a56-b274-efc617a8c16c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:07.131786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccb849-2f66-4a56-b274-efc617a8c16c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:07.133050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 603/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 16:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:57:07.139056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbc17-120c-4ef9-8809-1ba21d8ab6b6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:07.140069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbc17-120c-4ef9-8809-1ba21d8ab6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:07.140386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbc17-120c-4ef9-8809-1ba21d8ab6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:07.159781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-68cfbc17-120c-4ef9-8809-1ba21d8ab6b6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:57:07.160912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-68cfbc17-120c-4ef9-8809-1ba21d8ab6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:07.169082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 600/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:57:07.325865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccb849-2f66-4a56-b274-efc617a8c16c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:57:07.340117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccb849-2f66-4a56-b274-efc617a8c16c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:57:07.345740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277164f8-6dea-440c-acf7-818c49505737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:57:07.346324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277164f8-6dea-440c-acf7-818c49505737 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:07.346630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277164f8-6dea-440c-acf7-818c49505737 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:07.346900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277164f8-6dea-440c-acf7-818c49505737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:07.354747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277164f8-6dea-440c-acf7-818c49505737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:57:07.356308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277164f8-6dea-440c-acf7-818c49505737 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:57:07.366261 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 604/1204] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:57:11.310540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348fd34-0e79-442a-a9c4-9b7cf3729994 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:11.311662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348fd34-0e79-442a-a9c4-9b7cf3729994 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:11.311662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348fd34-0e79-442a-a9c4-9b7cf3729994 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:11.313135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 601/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:57:11.318331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042b4e-47af-437a-964b-5b9f8c9c1d5f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:11.318793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042b4e-47af-437a-964b-5b9f8c9c1d5f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:11.318930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042b4e-47af-437a-964b-5b9f8c9c1d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:11.338475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ac042b4e-47af-437a-964b-5b9f8c9c1d5f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:57:11.339685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ac042b4e-47af-437a-964b-5b9f8c9c1d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:11.348269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 605/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:57:11.638271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348fd34-0e79-442a-a9c4-9b7cf3729994 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:57:11.640733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e348fd34-0e79-442a-a9c4-9b7cf3729994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:11.667265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:57:11.721301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348fd34-0e79-442a-a9c4-9b7cf3729994 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:57:11.724914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3049c5f-b561-4330-9695-8b59b18b0301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:57:11.725515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049c5f-b561-4330-9695-8b59b18b0301 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:11.725795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049c5f-b561-4330-9695-8b59b18b0301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:11.726068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049c5f-b561-4330-9695-8b59b18b0301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:11.735574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049c5f-b561-4330-9695-8b59b18b0301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:57:11.737003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049c5f-b561-4330-9695-8b59b18b0301 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:57:11.746495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 602/1207] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:57:13.991399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb60a7-11b6-4d8a-b2b8-e76e7cfef310 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:13.991971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb60a7-11b6-4d8a-b2b8-e76e7cfef310 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:13.991971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb60a7-11b6-4d8a-b2b8-e76e7cfef310 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:13.993246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 606/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:57:13.999086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d951-8ddd-4de2-83eb-c769afaa6fa0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:13.999508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d951-8ddd-4de2-83eb-c769afaa6fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:13.999628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d951-8ddd-4de2-83eb-c769afaa6fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:14.019390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-93b1d951-8ddd-4de2-83eb-c769afaa6fa0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:57:14.020571 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-93b1d951-8ddd-4de2-83eb-c769afaa6fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:14.028153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 603/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:57:14.316359 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb60a7-11b6-4d8a-b2b8-e76e7cfef310 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:57:14.327251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb60a7-11b6-4d8a-b2b8-e76e7cfef310 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:57:14.330799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31a3f8-8cbe-45fa-8870-a5d771b7b007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:57:14.331392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31a3f8-8cbe-45fa-8870-a5d771b7b007 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:14.331674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31a3f8-8cbe-45fa-8870-a5d771b7b007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:14.331948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31a3f8-8cbe-45fa-8870-a5d771b7b007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:14.341040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31a3f8-8cbe-45fa-8870-a5d771b7b007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:57:14.343098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31a3f8-8cbe-45fa-8870-a5d771b7b007 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:57:14.352395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 607/1210] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:57:18.024744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0fb9-1b76-4ab9-835e-e37c67ffdadd None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:18.025343 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0fb9-1b76-4ab9-835e-e37c67ffdadd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:18.025343 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0fb9-1b76-4ab9-835e-e37c67ffdadd None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:18.026768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 604/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:57:18.033096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8bb51-0096-47f6-b620-1abca1c2f195 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:18.033551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8bb51-0096-47f6-b620-1abca1c2f195 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:18.033657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8bb51-0096-47f6-b620-1abca1c2f195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:18.053281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-46a8bb51-0096-47f6-b620-1abca1c2f195 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:57:18.054477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46a8bb51-0096-47f6-b620-1abca1c2f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:18.063211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 608/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:57:18.369453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee0fb9-1b76-4ab9-835e-e37c67ffdadd None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:57:18.371400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d6ee0fb9-1b76-4ab9-835e-e37c67ffdadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:18.448713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee0fb9-1b76-4ab9-835e-e37c67ffdadd None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:57:18.452810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b85ae-6bc9-4206-a037-3d2490c2a1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:57:18.453406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b85ae-6bc9-4206-a037-3d2490c2a1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:18.453686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b85ae-6bc9-4206-a037-3d2490c2a1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:18.453962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b85ae-6bc9-4206-a037-3d2490c2a1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:18.462625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b85ae-6bc9-4206-a037-3d2490c2a1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:57:18.464066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b85ae-6bc9-4206-a037-3d2490c2a1d1 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:57:18.473765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 605/1213] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:57:20.603819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915f5fe-027b-4146-9442-64fa3a93877a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:20.604351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915f5fe-027b-4146-9442-64fa3a93877a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:20.604351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915f5fe-027b-4146-9442-64fa3a93877a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:20.605624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 609/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 16:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:57:20.611505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658022eb-639b-443d-bf51-60837d869d7a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:20.611939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658022eb-639b-443d-bf51-60837d869d7a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:20.612099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658022eb-639b-443d-bf51-60837d869d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:20.632695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-658022eb-639b-443d-bf51-60837d869d7a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:57:20.633903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-658022eb-639b-443d-bf51-60837d869d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:20.641718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 606/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:57:20.944006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915f5fe-027b-4146-9442-64fa3a93877a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:57:20.945675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8915f5fe-027b-4146-9442-64fa3a93877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:57:20.959051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915f5fe-027b-4146-9442-64fa3a93877a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:57:20.962486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667dc52-09f8-4642-9440-f7f096722195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:57:20.963170 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667dc52-09f8-4642-9440-f7f096722195 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:57:20.963447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667dc52-09f8-4642-9440-f7f096722195 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:57:20.963719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667dc52-09f8-4642-9440-f7f096722195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:57:20.973132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667dc52-09f8-4642-9440-f7f096722195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:57:20.974566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667dc52-09f8-4642-9440-f7f096722195 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:57:20.983789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 610/1216] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:57:30.627887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=66 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:57:30.979647 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=34 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:47.540661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1bf10-d57b-4aee-8cee-d8cfc7aa950a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:47.542444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1bf10-d57b-4aee-8cee-d8cfc7aa950a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:47.542444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1bf10-d57b-4aee-8cee-d8cfc7aa950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:47.566812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f8a1bf10-d57b-4aee-8cee-d8cfc7aa950a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:47.570791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f8a1bf10-d57b-4aee-8cee-d8cfc7aa950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:47.582390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 607/1217] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:47.592942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6d91f-f0ca-4b30-809f-17f1c1c0bd8e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:47.593969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6d91f-f0ca-4b30-809f-17f1c1c0bd8e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:47.593969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6d91f-f0ca-4b30-809f-17f1c1c0bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:47.627922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9fd6d91f-f0ca-4b30-809f-17f1c1c0bd8e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:47.629164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9fd6d91f-f0ca-4b30-809f-17f1c1c0bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:47.638078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 611/1218] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:47.644146 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1bf10-d57b-4aee-8cee-d8cfc7aa950a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:47.659041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1bf10-d57b-4aee-8cee-d8cfc7aa950a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:47.665484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:47.666108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:47.666381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:47.666858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:47.667524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:47.667827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:47.669433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:47.692029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 608/1219] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:47.700891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6d91f-f0ca-4b30-809f-17f1c1c0bd8e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:47.717430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6d91f-f0ca-4b30-809f-17f1c1c0bd8e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:47.726978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398bd6b-42bc-4fd6-959a-c0d4506f092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:47.727611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398bd6b-42bc-4fd6-959a-c0d4506f092d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:47.727890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398bd6b-42bc-4fd6-959a-c0d4506f092d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:47.728162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398bd6b-42bc-4fd6-959a-c0d4506f092d admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:47.728831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398bd6b-42bc-4fd6-959a-c0d4506f092d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:47.731033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398bd6b-42bc-4fd6-959a-c0d4506f092d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:47.791427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 612/1220] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:47 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:47.796241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:47.816703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb252ecd-d1bd-4d74-8441-866521df6897 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:47.908556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fb79-dd7b-45ef-b350-551e0b65bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:47.909762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fb79-dd7b-45ef-b350-551e0b65bc04 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:47.910271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fb79-dd7b-45ef-b350-551e0b65bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:47.910811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fb79-dd7b-45ef-b350-551e0b65bc04 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:47.911718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0fb79-dd7b-45ef-b350-551e0b65bc04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:47.914046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0fb79-dd7b-45ef-b350-551e0b65bc04 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:47.965621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 609/1221] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:47 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:47.970688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398bd6b-42bc-4fd6-959a-c0d4506f092d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:47.985754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398bd6b-42bc-4fd6-959a-c0d4506f092d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:47.999336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df64195-fe75-44e9-8153-e4c00fdba6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.000573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64195-fe75-44e9-8153-e4c00fdba6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.001025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64195-fe75-44e9-8153-e4c00fdba6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.001301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64195-fe75-44e9-8153-e4c00fdba6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.001960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64195-fe75-44e9-8153-e4c00fdba6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.003624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64195-fe75-44e9-8153-e4c00fdba6d8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.016122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 613/1222] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:48.020432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fb79-dd7b-45ef-b350-551e0b65bc04 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.037042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fb79-dd7b-45ef-b350-551e0b65bc04 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.044464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69a57-a4d6-4c94-ae06-a62161dd0dec None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.044722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69a57-a4d6-4c94-ae06-a62161dd0dec None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.044955 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69a57-a4d6-4c94-ae06-a62161dd0dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.047197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f78b9-480c-4e94-9317-f0b03ee3f0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.048084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f78b9-480c-4e94-9317-f0b03ee3f0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.048635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f78b9-480c-4e94-9317-f0b03ee3f0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.049150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f78b9-480c-4e94-9317-f0b03ee3f0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.049994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f78b9-480c-4e94-9317-f0b03ee3f0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.051985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f78b9-480c-4e94-9317-f0b03ee3f0e6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.077827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 610/1223] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:48.083309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f78b9-480c-4e94-9317-f0b03ee3f0e6 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.095595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-32f69a57-a4d6-4c94-ae06-a62161dd0dec None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.098466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-32f69a57-a4d6-4c94-ae06-a62161dd0dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.107515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f78b9-480c-4e94-9317-f0b03ee3f0e6 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.119100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 614/1224] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.119982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8ff1-2364-4433-8e4c-b51f40be929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.120872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8ff1-2364-4433-8e4c-b51f40be929b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.121352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8ff1-2364-4433-8e4c-b51f40be929b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.123317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e9262-c35f-4fb7-99ea-0c98d144e45c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.123832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e9262-c35f-4fb7-99ea-0c98d144e45c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.124312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e9262-c35f-4fb7-99ea-0c98d144e45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.125162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8ff1-2364-4433-8e4c-b51f40be929b admin admin] PATH_INFO: `/v3/projects/7be9eb4c93a14498a58bedab2bb24736/users/7f9861341d2543b4bb41b3b4c5c9bd2f/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.146749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8ff1-2364-4433-8e4c-b51f40be929b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be9eb4c93a14498a58bedab2bb24736, user_id=7f9861341d2543b4bb41b3b4c5c9bd2f, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.149422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8ff1-2364-4433-8e4c-b51f40be929b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.170050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-086e9262-c35f-4fb7-99ea-0c98d144e45c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.171454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-086e9262-c35f-4fb7-99ea-0c98d144e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.185973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 611/1225] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:48 2022] PUT /identity/v3/projects/7be9eb4c93a14498a58bedab2bb24736/users/7f9861341d2543b4bb41b3b4c5c9bd2f/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:48.187917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8def9-c06c-4114-8170-41af664cf7f5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.188202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8def9-c06c-4114-8170-41af664cf7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.188476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8def9-c06c-4114-8170-41af664cf7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.236708 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5da8def9-c06c-4114-8170-41af664cf7f5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.238164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5da8def9-c06c-4114-8170-41af664cf7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.288466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 615/1226] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.290001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2f8e7-29c4-479b-b084-1ee53853b8b1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.290470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2f8e7-29c4-479b-b084-1ee53853b8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.290777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2f8e7-29c4-479b-b084-1ee53853b8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.308079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 612/1227] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.310630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b71352-15d3-4866-bb35-662a131dc161 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.310931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b71352-15d3-4866-bb35-662a131dc161 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.311209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b71352-15d3-4866-bb35-662a131dc161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.317779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5bb2f8e7-29c4-479b-b084-1ee53853b8b1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.319225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5bb2f8e7-29c4-479b-b084-1ee53853b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.327129 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 616/1228] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.329597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4ac5-9d55-49d2-8ef1-1ae5232f6de6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.329877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4ac5-9d55-49d2-8ef1-1ae5232f6de6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.330150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff4ac5-9d55-49d2-8ef1-1ae5232f6de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.344980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e5b71352-15d3-4866-bb35-662a131dc161 None None] MFA Rules not processed for user `7f9861341d2543b4bb41b3b4c5c9bd2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.346193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e5b71352-15d3-4866-bb35-662a131dc161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.351628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1fff4ac5-9d55-49d2-8ef1-1ae5232f6de6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.352781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1fff4ac5-9d55-49d2-8ef1-1ae5232f6de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.361842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 617/1229] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.363127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae6a38-1fb3-4473-b343-032f1940a999 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.363417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae6a38-1fb3-4473-b343-032f1940a999 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.363686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae6a38-1fb3-4473-b343-032f1940a999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.371534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:48.384367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-94ae6a38-1fb3-4473-b343-032f1940a999 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.385606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-94ae6a38-1fb3-4473-b343-032f1940a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.393929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 618/1230] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.395072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e177-ddbb-482e-9b18-a4d46d72ed43 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.395355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e177-ddbb-482e-9b18-a4d46d72ed43 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.395629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e177-ddbb-482e-9b18-a4d46d72ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.414857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-da32e177-ddbb-482e-9b18-a4d46d72ed43 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.416040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-da32e177-ddbb-482e-9b18-a4d46d72ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.418940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 613/1231] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.424122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6c08-adef-41a9-96ba-2a987bb49374 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.424122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6c08-adef-41a9-96ba-2a987bb49374 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.424122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6c08-adef-41a9-96ba-2a987bb49374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.432085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 619/1232] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.432085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9245133-d39a-438b-96b2-aa4a11a1bbe4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.432085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9245133-d39a-438b-96b2-aa4a11a1bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.432085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9245133-d39a-438b-96b2-aa4a11a1bbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.442993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-876c6c08-adef-41a9-96ba-2a987bb49374 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.444180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-876c6c08-adef-41a9-96ba-2a987bb49374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.447514 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a9245133-d39a-438b-96b2-aa4a11a1bbe4 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.448738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a9245133-d39a-438b-96b2-aa4a11a1bbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.458640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 614/1233] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.458640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c6c08-adef-41a9-96ba-2a987bb49374 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.462300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 620/1234] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.463863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f80e3b-9fbd-4adf-82ae-4315a6c3bfa0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.464361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f80e3b-9fbd-4adf-82ae-4315a6c3bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.464848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f80e3b-9fbd-4adf-82ae-4315a6c3bfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.467006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c6c08-adef-41a9-96ba-2a987bb49374 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.473017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8bdc1-cb6b-4553-b581-ed2abbfdcfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.473716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bdc1-cb6b-4553-b581-ed2abbfdcfbe admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.474006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bdc1-cb6b-4553-b581-ed2abbfdcfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.474283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8bdc1-cb6b-4553-b581-ed2abbfdcfbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.474974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8bdc1-cb6b-4553-b581-ed2abbfdcfbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:48.475285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8bdc1-cb6b-4553-b581-ed2abbfdcfbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.476890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8bdc1-cb6b-4553-b581-ed2abbfdcfbe admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.485599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-01f80e3b-9fbd-4adf-82ae-4315a6c3bfa0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.486834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-01f80e3b-9fbd-4adf-82ae-4315a6c3bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.489308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 615/1235] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:48.490559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09825b9-1267-4bf4-9375-e48a55790cc5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.490839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09825b9-1267-4bf4-9375-e48a55790cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.491124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09825b9-1267-4bf4-9375-e48a55790cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.502429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 621/1236] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.503688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5bde4-dfbe-4458-940e-32e866b0d00e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.503974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5bde4-dfbe-4458-940e-32e866b0d00e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.504249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5bde4-dfbe-4458-940e-32e866b0d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.514438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e09825b9-1267-4bf4-9375-e48a55790cc5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.515786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e09825b9-1267-4bf4-9375-e48a55790cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.523391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b9c5bde4-dfbe-4458-940e-32e866b0d00e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.523754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 616/1237] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.524362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b9c5bde4-dfbe-4458-940e-32e866b0d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.524944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7edeb-7c64-486b-bff7-8452abb7791b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.525227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7edeb-7c64-486b-bff7-8452abb7791b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.525497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7edeb-7c64-486b-bff7-8452abb7791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.533284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 622/1238] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.534334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e890d-0275-45f9-b31c-ba9f72958c80 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.534644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e890d-0275-45f9-b31c-ba9f72958c80 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.534916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e890d-0275-45f9-b31c-ba9f72958c80 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.536132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 623/1239] 10.222.0.27 () {54 vars in 961 bytes} [Mon Oct 10 16:58:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:58:48.537127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d0943-4044-4958-85c1-c3b01735f5b1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.537405 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d0943-4044-4958-85c1-c3b01735f5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.537671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d0943-4044-4958-85c1-c3b01735f5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.553833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-fea7edeb-7c64-486b-bff7-8452abb7791b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.555300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fea7edeb-7c64-486b-bff7-8452abb7791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.559187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-673d0943-4044-4958-85c1-c3b01735f5b1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.560316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-673d0943-4044-4958-85c1-c3b01735f5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.565720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 617/1240] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.566597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7edeb-7c64-486b-bff7-8452abb7791b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.570087 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 624/1241] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.571052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d0943-4044-4958-85c1-c3b01735f5b1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.579502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7edeb-7c64-486b-bff7-8452abb7791b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.581522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d0943-4044-4958-85c1-c3b01735f5b1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.585337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.585937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.586198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.586510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.586635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45f263-1a2e-40ee-8543-1b2b5e42a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.587196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f263-1a2e-40ee-8543-1b2b5e42a7bf admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.587309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:48.587472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f263-1a2e-40ee-8543-1b2b5e42a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.587588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.587744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f263-1a2e-40ee-8543-1b2b5e42a7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.588372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45f263-1a2e-40ee-8543-1b2b5e42a7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.589086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.590248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45f263-1a2e-40ee-8543-1b2b5e42a7bf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.601668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 618/1242] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:48.602698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.614446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297010f1-af8a-463d-a251-d7b333b0d49f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.618442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 625/1243] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:48.619604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45f263-1a2e-40ee-8543-1b2b5e42a7bf admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.622475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.623103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.623382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.623769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.624297 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:48.624634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.626434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.639305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 619/1244] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:48.640677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.652219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141342df-2ca1-49c6-9b30-4e131dac78ac admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.654509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:48.686678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45f263-1a2e-40ee-8543-1b2b5e42a7bf admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.691870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8513f1-21bb-4f12-bc98-48714ee8f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.692807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8513f1-21bb-4f12-bc98-48714ee8f205 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.692807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8513f1-21bb-4f12-bc98-48714ee8f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.693063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8513f1-21bb-4f12-bc98-48714ee8f205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.693714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8513f1-21bb-4f12-bc98-48714ee8f205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:48.694064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8513f1-21bb-4f12-bc98-48714ee8f205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.695117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-9e8513f1-21bb-4f12-bc98-48714ee8f205 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:58:48.695117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 10 16:58:48.695117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: Oct 10 16:58:48.696122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8513f1-21bb-4f12-bc98-48714ee8f205 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.708895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 626/1245] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:48.709921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937427c8-a223-4124-a901-20672e7ccceb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.710208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937427c8-a223-4124-a901-20672e7ccceb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.710486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937427c8-a223-4124-a901-20672e7ccceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.716578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.717198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.717479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.717758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.718454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:48.718884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.720505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.739500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 620/1246] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:48.739500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.744876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4640762-e026-4156-8d3b-105f74f1a6bc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.748020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-937427c8-a223-4124-a901-20672e7ccceb None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:48.749227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-937427c8-a223-4124-a901-20672e7ccceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:48.749962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.750582 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.750868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.751140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.751793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:48.752078 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.753673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.767855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 621/1247] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:48.768775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.778977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350c6aa-7283-4169-8fb3-0baba8465f17 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.784439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.785015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.785289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.785558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.786187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:48.786483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.788080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.799955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 622/1248] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:48.800809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.810536 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a3859-1189-4216-b261-c436b9bf4b78 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.815015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.815584 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.815857 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.816125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.816739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.817760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:58:48.817760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:58:48.817760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:58:48.818979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.824621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 627/1249] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:48.825374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937427c8-a223-4124-a901-20672e7ccceb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.836160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937427c8-a223-4124-a901-20672e7ccceb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.841570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.842174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.842460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.842798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.843950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.844961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:58:48.844961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 10 16:58:48.844961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: Oct 10 16:58:48.846161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.850803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 623/1250] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:48.850803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.863179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:48.870543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 628/1251] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:48.871554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.882799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7fc31-6f39-4822-ab60-bf00264c4b8e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.922142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d025-805d-4573-9943-2117fc8ee3e5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:48.927635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de94ce6-79da-467d-9ce0-5ec725cea32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.928569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de94ce6-79da-467d-9ce0-5ec725cea32e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.928980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de94ce6-79da-467d-9ce0-5ec725cea32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.929292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de94ce6-79da-467d-9ce0-5ec725cea32e admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.930051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de94ce6-79da-467d-9ce0-5ec725cea32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.932114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de94ce6-79da-467d-9ce0-5ec725cea32e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.939594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7f309-50be-4571-b671-b005d33c3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:48.940237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f309-50be-4571-b671-b005d33c3827 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:48.940515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f309-50be-4571-b671-b005d33c3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:48.940785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f309-50be-4571-b671-b005d33c3827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:48.941420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7f309-50be-4571-b671-b005d33c3827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:48.943344 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7f309-50be-4571-b671-b005d33c3827 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:48.960169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 624/1252] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:48.961196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de94ce6-79da-467d-9ce0-5ec725cea32e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.971912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 629/1253] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:48.973081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7f309-50be-4571-b671-b005d33c3827 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:48.987305 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:49.023820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de94ce6-79da-467d-9ce0-5ec725cea32e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.041311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7f309-50be-4571-b671-b005d33c3827 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.047777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874b45-fd94-40b0-b51b-2acd1e794797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.048834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874b45-fd94-40b0-b51b-2acd1e794797 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.048834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874b45-fd94-40b0-b51b-2acd1e794797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.049014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874b45-fd94-40b0-b51b-2acd1e794797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.049549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16874b45-fd94-40b0-b51b-2acd1e794797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.051644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16874b45-fd94-40b0-b51b-2acd1e794797 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.081267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 630/1254] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.082138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874b45-fd94-40b0-b51b-2acd1e794797 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.085960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7918fae-bcc8-4479-81aa-02ca70c75333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.086603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918fae-bcc8-4479-81aa-02ca70c75333 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.086883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918fae-bcc8-4479-81aa-02ca70c75333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.087362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918fae-bcc8-4479-81aa-02ca70c75333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.088012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7918fae-bcc8-4479-81aa-02ca70c75333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.090067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7918fae-bcc8-4479-81aa-02ca70c75333 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.118178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 625/1255] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:48 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.119323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7918fae-bcc8-4479-81aa-02ca70c75333 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.146505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874b45-fd94-40b0-b51b-2acd1e794797 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.152255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:49.192826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7918fae-bcc8-4479-81aa-02ca70c75333 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.198494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3adb5-eeab-41dc-8c57-4b3cda3aa517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.199113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3adb5-eeab-41dc-8c57-4b3cda3aa517 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.199386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3adb5-eeab-41dc-8c57-4b3cda3aa517 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.199657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3adb5-eeab-41dc-8c57-4b3cda3aa517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.205816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b909f-05cf-4f4a-81ee-013c2ecea96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.206427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b909f-05cf-4f4a-81ee-013c2ecea96b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.206752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b909f-05cf-4f4a-81ee-013c2ecea96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.207031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b909f-05cf-4f4a-81ee-013c2ecea96b admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.207665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b909f-05cf-4f4a-81ee-013c2ecea96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.209580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b909f-05cf-4f4a-81ee-013c2ecea96b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.237834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 631/1256] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.239069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b909f-05cf-4f4a-81ee-013c2ecea96b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.259016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3adb5-eeab-41dc-8c57-4b3cda3aa517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.260806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3adb5-eeab-41dc-8c57-4b3cda3aa517 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.270774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 626/1257] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:49.271523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3adb5-eeab-41dc-8c57-4b3cda3aa517 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.275869 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:49.285000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3adb5-eeab-41dc-8c57-4b3cda3aa517 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.315363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b909f-05cf-4f4a-81ee-013c2ecea96b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.321764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3721f-0ed5-4123-94a8-612471e709e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.322813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3721f-0ed5-4123-94a8-612471e709e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.323256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3721f-0ed5-4123-94a8-612471e709e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.323711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3721f-0ed5-4123-94a8-612471e709e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.325029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3721f-0ed5-4123-94a8-612471e709e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.328530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3721f-0ed5-4123-94a8-612471e709e4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.367358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bfc33-657f-437d-937a-eeddcacb5149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.368037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfc33-657f-437d-937a-eeddcacb5149 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.368390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfc33-657f-437d-937a-eeddcacb5149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.368725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfc33-657f-437d-937a-eeddcacb5149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.369734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bfc33-657f-437d-937a-eeddcacb5149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.369857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 632/1258] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.370812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3721f-0ed5-4123-94a8-612471e709e4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.371864 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bfc33-657f-437d-937a-eeddcacb5149 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.382226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3721f-0ed5-4123-94a8-612471e709e4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.386015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 627/1259] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.387099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bfc33-657f-437d-937a-eeddcacb5149 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.389780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db797e-aef6-421f-800c-2d59dd8098ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.390500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db797e-aef6-421f-800c-2d59dd8098ac admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.390892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db797e-aef6-421f-800c-2d59dd8098ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.391235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db797e-aef6-421f-800c-2d59dd8098ac admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.391946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db797e-aef6-421f-800c-2d59dd8098ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.393939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db797e-aef6-421f-800c-2d59dd8098ac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.399312 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bfc33-657f-437d-937a-eeddcacb5149 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.404203 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63e07e-528c-4915-819e-4333fc324d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.405360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63e07e-528c-4915-819e-4333fc324d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.406207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63e07e-528c-4915-819e-4333fc324d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.406752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63e07e-528c-4915-819e-4333fc324d08 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.407867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63e07e-528c-4915-819e-4333fc324d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.410527 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63e07e-528c-4915-819e-4333fc324d08 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.426701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 633/1260] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/users => generated 292 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.428046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db797e-aef6-421f-800c-2d59dd8098ac admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.442225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db797e-aef6-421f-800c-2d59dd8098ac admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.446986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 628/1261] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/users => generated 283 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.447876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63e07e-528c-4915-819e-4333fc324d08 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.448657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d5af3-13d8-4ef9-9cd2-25caf8289658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.449272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d5af3-13d8-4ef9-9cd2-25caf8289658 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.449683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d5af3-13d8-4ef9-9cd2-25caf8289658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.450024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d5af3-13d8-4ef9-9cd2-25caf8289658 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.450708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d5af3-13d8-4ef9-9cd2-25caf8289658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.453098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d5af3-13d8-4ef9-9cd2-25caf8289658 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.459122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63e07e-528c-4915-819e-4333fc324d08 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.465399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8607-b25e-460a-af09-b2fc989a0251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.466575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8607-b25e-460a-af09-b2fc989a0251 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.466937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8607-b25e-460a-af09-b2fc989a0251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.467281 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8607-b25e-460a-af09-b2fc989a0251 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.468783 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f8607-b25e-460a-af09-b2fc989a0251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.471533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f8607-b25e-460a-af09-b2fc989a0251 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.498694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 634/1262] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/users => generated 290 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.498694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d5af3-13d8-4ef9-9cd2-25caf8289658 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.499871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 629/1263] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/users => generated 286 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.500798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8607-b25e-460a-af09-b2fc989a0251 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.510567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8607-b25e-460a-af09-b2fc989a0251 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.512626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d5af3-13d8-4ef9-9cd2-25caf8289658 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.515326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f848f-d14e-4f9c-b5e4-c472cbbea99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.516001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f848f-d14e-4f9c-b5e4-c472cbbea99d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.516283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f848f-d14e-4f9c-b5e4-c472cbbea99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.516553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f848f-d14e-4f9c-b5e4-c472cbbea99d admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.517186 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f848f-d14e-4f9c-b5e4-c472cbbea99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.519022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f848f-d14e-4f9c-b5e4-c472cbbea99d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.519683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841be34-9d6c-43f3-9a2d-937d0a1256ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.520642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841be34-9d6c-43f3-9a2d-937d0a1256ea admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.521166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841be34-9d6c-43f3-9a2d-937d0a1256ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.521443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841be34-9d6c-43f3-9a2d-937d0a1256ea admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.522252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841be34-9d6c-43f3-9a2d-937d0a1256ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.524545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841be34-9d6c-43f3-9a2d-937d0a1256ea admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.529501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 630/1264] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.530317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f848f-d14e-4f9c-b5e4-c472cbbea99d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.541359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f848f-d14e-4f9c-b5e4-c472cbbea99d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.547323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fe2e8-e27f-423c-b677-530caacf1b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.548284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fe2e8-e27f-423c-b677-530caacf1b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.548425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fe2e8-e27f-423c-b677-530caacf1b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.548639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fe2e8-e27f-423c-b677-530caacf1b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.549450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fe2e8-e27f-423c-b677-530caacf1b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.551310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fe2e8-e27f-423c-b677-530caacf1b67 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.562665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 635/1265] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/users => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:49.562665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841be34-9d6c-43f3-9a2d-937d0a1256ea admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.564713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 631/1266] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.565317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fe2e8-e27f-423c-b677-530caacf1b67 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.572185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:49.576337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fe2e8-e27f-423c-b677-530caacf1b67 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.580748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841be34-9d6c-43f3-9a2d-937d0a1256ea admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.582093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b8135-1b19-42be-9878-a9ed5df939e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.582805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b8135-1b19-42be-9878-a9ed5df939e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.583301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b8135-1b19-42be-9878-a9ed5df939e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.583749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b8135-1b19-42be-9878-a9ed5df939e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.584575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b8135-1b19-42be-9878-a9ed5df939e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.586237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b8135-1b19-42be-9878-a9ed5df939e7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.586367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612f00-4fd9-4e74-9a12-50141f393772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.587044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612f00-4fd9-4e74-9a12-50141f393772 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.587407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612f00-4fd9-4e74-9a12-50141f393772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.587755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35612f00-4fd9-4e74-9a12-50141f393772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.588473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35612f00-4fd9-4e74-9a12-50141f393772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.590149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35612f00-4fd9-4e74-9a12-50141f393772 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.597410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 632/1267] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.598202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b8135-1b19-42be-9878-a9ed5df939e7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.606431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 636/1268] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.606431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612f00-4fd9-4e74-9a12-50141f393772 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.608324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b8135-1b19-42be-9878-a9ed5df939e7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.613744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c535-1609-4f25-9a76-2791c014e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.614340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c535-1609-4f25-9a76-2791c014e268 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.614671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c535-1609-4f25-9a76-2791c014e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.614953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c535-1609-4f25-9a76-2791c014e268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.615596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c535-1609-4f25-9a76-2791c014e268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.616815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35612f00-4fd9-4e74-9a12-50141f393772 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.617237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c535-1609-4f25-9a76-2791c014e268 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.621977 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3158653-2573-465c-bfbb-8c38033ecc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.622587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3158653-2573-465c-bfbb-8c38033ecc22 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.623148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3158653-2573-465c-bfbb-8c38033ecc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.623282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3158653-2573-465c-bfbb-8c38033ecc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.623851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3158653-2573-465c-bfbb-8c38033ecc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.626346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3158653-2573-465c-bfbb-8c38033ecc22 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.628648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 633/1269] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.629907 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2078-ec96-49b8-bc6d-e716be190dc5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.630196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2078-ec96-49b8-bc6d-e716be190dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.630468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2078-ec96-49b8-bc6d-e716be190dc5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.631829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 634/1270] 10.222.0.27 () {54 vars in 912 bytes} [Mon Oct 10 16:58:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:58:49.636496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c2078-ec96-49b8-bc6d-e716be190dc5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.638480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 637/1271] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.639604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3158653-2573-465c-bfbb-8c38033ecc22 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.652629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3158653-2573-465c-bfbb-8c38033ecc22 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.657326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c2078-ec96-49b8-bc6d-e716be190dc5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.661593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8a71e-cd47-4333-889f-b29851d5bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.662199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a71e-cd47-4333-889f-b29851d5bbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.662480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a71e-cd47-4333-889f-b29851d5bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.662798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8a71e-cd47-4333-889f-b29851d5bbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.663437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8a71e-cd47-4333-889f-b29851d5bbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.663865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d793802-450c-48db-a9f4-1aed19814e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.664526 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793802-450c-48db-a9f4-1aed19814e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.665227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793802-450c-48db-a9f4-1aed19814e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.665351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8a71e-cd47-4333-889f-b29851d5bbf4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.665444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793802-450c-48db-a9f4-1aed19814e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.665886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d793802-450c-48db-a9f4-1aed19814e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.667595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d793802-450c-48db-a9f4-1aed19814e36 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.677019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 638/1272] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.678058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8a71e-cd47-4333-889f-b29851d5bbf4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.679870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 635/1273] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.680741 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d793802-450c-48db-a9f4-1aed19814e36 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.688708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8a71e-cd47-4333-889f-b29851d5bbf4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.692895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d793802-450c-48db-a9f4-1aed19814e36 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.693584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05704-4064-4dd9-90bc-2842d867a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.694279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05704-4064-4dd9-90bc-2842d867a10a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.694582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05704-4064-4dd9-90bc-2842d867a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.694863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05704-4064-4dd9-90bc-2842d867a10a admin admin] PATH_INFO: `/v3/projects/b4f5324f494f4c6f9193a0cfb5466f3a/users/4e66774737b5439d8b615cbb271f1faa/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.697884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542cf79-fe1b-44b4-9eb0-160a568cacaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.698469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542cf79-fe1b-44b4-9eb0-160a568cacaa admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.698800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542cf79-fe1b-44b4-9eb0-160a568cacaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.699047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542cf79-fe1b-44b4-9eb0-160a568cacaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.699789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542cf79-fe1b-44b4-9eb0-160a568cacaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.701380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542cf79-fe1b-44b4-9eb0-160a568cacaa admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.710475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e05704-4064-4dd9-90bc-2842d867a10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f5324f494f4c6f9193a0cfb5466f3a, user_id=4e66774737b5439d8b615cbb271f1faa, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.713183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e05704-4064-4dd9-90bc-2842d867a10a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.718760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 636/1274] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.722227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542cf79-fe1b-44b4-9eb0-160a568cacaa admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.731421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 639/1275] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:49 2022] PUT /identity/v3/projects/b4f5324f494f4c6f9193a0cfb5466f3a/users/4e66774737b5439d8b615cbb271f1faa/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:49.732048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05704-4064-4dd9-90bc-2842d867a10a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.737853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542cf79-fe1b-44b4-9eb0-160a568cacaa admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.794030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415643c2-3f3f-4f4b-beb1-9bc37ee13ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.794660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415643c2-3f3f-4f4b-beb1-9bc37ee13ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.794940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415643c2-3f3f-4f4b-beb1-9bc37ee13ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.795209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415643c2-3f3f-4f4b-beb1-9bc37ee13ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.795876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415643c2-3f3f-4f4b-beb1-9bc37ee13ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.797131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05704-4064-4dd9-90bc-2842d867a10a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.798256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415643c2-3f3f-4f4b-beb1-9bc37ee13ffc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.801983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60fc3d-eca6-47fe-bd2f-dc5c5cc0a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.802612 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60fc3d-eca6-47fe-bd2f-dc5c5cc0a897 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.802892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60fc3d-eca6-47fe-bd2f-dc5c5cc0a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.803164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60fc3d-eca6-47fe-bd2f-dc5c5cc0a897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.804292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60fc3d-eca6-47fe-bd2f-dc5c5cc0a897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.805865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60fc3d-eca6-47fe-bd2f-dc5c5cc0a897 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.808136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 637/1276] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.811475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e062d-5d55-486b-b62a-81038881ba17 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.811475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e062d-5d55-486b-b62a-81038881ba17 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.811475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e062d-5d55-486b-b62a-81038881ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.819850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 640/1277] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.819850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60fc3d-eca6-47fe-bd2f-dc5c5cc0a897 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.823662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:49.827188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60fc3d-eca6-47fe-bd2f-dc5c5cc0a897 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.831230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-270e062d-5d55-486b-b62a-81038881ba17 None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:49.832529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-270e062d-5d55-486b-b62a-81038881ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:49.833478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee3a67-f545-4471-9f6a-c2ad28d5bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.834063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3a67-f545-4471-9f6a-c2ad28d5bd1d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.834339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3a67-f545-4471-9f6a-c2ad28d5bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.834636 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3a67-f545-4471-9f6a-c2ad28d5bd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.835259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee3a67-f545-4471-9f6a-c2ad28d5bd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.836830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee3a67-f545-4471-9f6a-c2ad28d5bd1d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.847386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 641/1278] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.848179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee3a67-f545-4471-9f6a-c2ad28d5bd1d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.857916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee3a67-f545-4471-9f6a-c2ad28d5bd1d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.862671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2ebc-9056-4521-93f0-4c782b14aa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.863417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2ebc-9056-4521-93f0-4c782b14aa7f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.863699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2ebc-9056-4521-93f0-4c782b14aa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.864028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2ebc-9056-4521-93f0-4c782b14aa7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.864719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed2ebc-9056-4521-93f0-4c782b14aa7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.866294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed2ebc-9056-4521-93f0-4c782b14aa7f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.878176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 642/1279] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:49.879074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2ebc-9056-4521-93f0-4c782b14aa7f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.892710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2ebc-9056-4521-93f0-4c782b14aa7f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.897602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a719f-dd1c-4b28-baef-1beeb36110df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.898258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a719f-dd1c-4b28-baef-1beeb36110df admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.898626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a719f-dd1c-4b28-baef-1beeb36110df admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.898903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a719f-dd1c-4b28-baef-1beeb36110df admin admin] PATH_INFO: `/v3/projects/4514345efc0145fcbcf0292f4048b9ef/users/0046dc0cc60049ae8ea43797c84aef61/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.913506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 638/1280] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:49.914126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a719f-dd1c-4b28-baef-1beeb36110df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4514345efc0145fcbcf0292f4048b9ef, user_id=0046dc0cc60049ae8ea43797c84aef61, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:49.914565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e062d-5d55-486b-b62a-81038881ba17 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:49.916803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a719f-dd1c-4b28-baef-1beeb36110df admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:49.925963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e062d-5d55-486b-b62a-81038881ba17 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:49.932753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 643/1281] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:49 2022] PUT /identity/v3/projects/4514345efc0145fcbcf0292f4048b9ef/users/0046dc0cc60049ae8ea43797c84aef61/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:49.934154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adabb50-d534-43e6-bfbe-e6de002f5f97 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.934645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adabb50-d534-43e6-bfbe-e6de002f5f97 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.934928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adabb50-d534-43e6-bfbe-e6de002f5f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:49.955598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2adabb50-d534-43e6-bfbe-e6de002f5f97 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:49.956789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2adabb50-d534-43e6-bfbe-e6de002f5f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:49.973569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:49.986454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2539ef4-4793-485b-b3ad-e9a76e18b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:49.987281 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539ef4-4793-485b-b3ad-e9a76e18b201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:49.987635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539ef4-4793-485b-b3ad-e9a76e18b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:49.987976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539ef4-4793-485b-b3ad-e9a76e18b201 admin admin] PATH_INFO: `/v3/projects/8d0b29d7d845487b921e7559db108e5c/users/e997d99ab00441c7a82e175e4f7b960e/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.003192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2539ef4-4793-485b-b3ad-e9a76e18b201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0b29d7d845487b921e7559db108e5c, user_id=e997d99ab00441c7a82e175e4f7b960e, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.005965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2539ef4-4793-485b-b3ad-e9a76e18b201 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.019747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 644/1282] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:50.030949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 639/1283] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:49 2022] PUT /identity/v3/projects/8d0b29d7d845487b921e7559db108e5c/users/e997d99ab00441c7a82e175e4f7b960e/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:50.031722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adabb50-d534-43e6-bfbe-e6de002f5f97 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.031832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2539ef4-4793-485b-b3ad-e9a76e18b201 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.040640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adabb50-d534-43e6-bfbe-e6de002f5f97 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.094942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2539ef4-4793-485b-b3ad-e9a76e18b201 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.097578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff67e-f839-4b24-8579-c3b4b8d2759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.098237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff67e-f839-4b24-8579-c3b4b8d2759d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.098511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff67e-f839-4b24-8579-c3b4b8d2759d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.098822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff67e-f839-4b24-8579-c3b4b8d2759d admin admin] PATH_INFO: `/v3/projects/2a0cf8ef665d40da8d0ff8c6024c9f22/users/9d51c7335010488d8a2bdc329f975dae/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.099593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccde72c-4d44-45bf-911a-023d55402fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.100247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccde72c-4d44-45bf-911a-023d55402fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.100531 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccde72c-4d44-45bf-911a-023d55402fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.100931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccde72c-4d44-45bf-911a-023d55402fd8 admin admin] PATH_INFO: `/v3/projects/8d4783c327b0464f8ab59e9f72b330f8/users/011c3876fb3c4e5296f5fa164b7b886b/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.113849 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ff67e-f839-4b24-8579-c3b4b8d2759d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0cf8ef665d40da8d0ff8c6024c9f22, user_id=9d51c7335010488d8a2bdc329f975dae, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.115818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccde72c-4d44-45bf-911a-023d55402fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4783c327b0464f8ab59e9f72b330f8, user_id=011c3876fb3c4e5296f5fa164b7b886b, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.116801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ff67e-f839-4b24-8579-c3b4b8d2759d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.118473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccde72c-4d44-45bf-911a-023d55402fd8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.130364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 645/1284] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:50 2022] PUT /identity/v3/projects/2a0cf8ef665d40da8d0ff8c6024c9f22/users/9d51c7335010488d8a2bdc329f975dae/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:50.131151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff67e-f839-4b24-8579-c3b4b8d2759d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.135564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 640/1285] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:50 2022] PUT /identity/v3/projects/8d4783c327b0464f8ab59e9f72b330f8/users/011c3876fb3c4e5296f5fa164b7b886b/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:50.135564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccde72c-4d44-45bf-911a-023d55402fd8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.182834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:50.197393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccde72c-4d44-45bf-911a-023d55402fd8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.202469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff67e-f839-4b24-8579-c3b4b8d2759d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.203220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe33129-2583-4221-b3b6-261c17c2ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.203884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe33129-2583-4221-b3b6-261c17c2ddf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.204163 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe33129-2583-4221-b3b6-261c17c2ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.204443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe33129-2583-4221-b3b6-261c17c2ddf3 admin admin] PATH_INFO: `/v3/projects/c36e8e400d8f4a6288078bd8b2a9b889/users/ddf163d4b0a1468e903ca33b69247d47/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.208810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeacae-a0f9-49b3-996c-ec1377d816e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.209473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeacae-a0f9-49b3-996c-ec1377d816e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.209756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeacae-a0f9-49b3-996c-ec1377d816e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.210034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeacae-a0f9-49b3-996c-ec1377d816e9 admin admin] PATH_INFO: `/v3/projects/e5340bac0fcf4c2994b03e03974de722/users/0aa6e52d7dc64fdfb30240cee508a82d/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.219090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe33129-2583-4221-b3b6-261c17c2ddf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36e8e400d8f4a6288078bd8b2a9b889, user_id=ddf163d4b0a1468e903ca33b69247d47, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.221752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe33129-2583-4221-b3b6-261c17c2ddf3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.225217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeacae-a0f9-49b3-996c-ec1377d816e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5340bac0fcf4c2994b03e03974de722, user_id=0aa6e52d7dc64fdfb30240cee508a82d, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.228673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeacae-a0f9-49b3-996c-ec1377d816e9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.235947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 641/1286] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:50 2022] PUT /identity/v3/projects/c36e8e400d8f4a6288078bd8b2a9b889/users/ddf163d4b0a1468e903ca33b69247d47/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:50.237624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe33129-2583-4221-b3b6-261c17c2ddf3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.241969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 646/1287] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:50 2022] PUT /identity/v3/projects/e5340bac0fcf4c2994b03e03974de722/users/0aa6e52d7dc64fdfb30240cee508a82d/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:50.243022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f15b71-5790-425a-94a5-480d0d4aa2d3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.243315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f15b71-5790-425a-94a5-480d0d4aa2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.243595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f15b71-5790-425a-94a5-480d0d4aa2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.263900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d4f15b71-5790-425a-94a5-480d0d4aa2d3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:50.265713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4f15b71-5790-425a-94a5-480d0d4aa2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:50.288852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:50.304771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe33129-2583-4221-b3b6-261c17c2ddf3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.325954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 647/1288] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:50.326820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f15b71-5790-425a-94a5-480d0d4aa2d3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.355211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b942650-8aa4-40bf-8ceb-8b9cc058a666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.355818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942650-8aa4-40bf-8ceb-8b9cc058a666 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.356099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942650-8aa4-40bf-8ceb-8b9cc058a666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.356373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942650-8aa4-40bf-8ceb-8b9cc058a666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.382656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f15b71-5790-425a-94a5-480d0d4aa2d3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.386228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761a05-da02-495e-be23-bed087d47f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.386867 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761a05-da02-495e-be23-bed087d47f06 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.387148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761a05-da02-495e-be23-bed087d47f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.387424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761a05-da02-495e-be23-bed087d47f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.396682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761a05-da02-495e-be23-bed087d47f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.398110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761a05-da02-495e-be23-bed087d47f06 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.408151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 648/1289] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:50.409365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b19c84-2324-4af2-8c2b-fe42135ab2f5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.409602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b19c84-2324-4af2-8c2b-fe42135ab2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.409872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b19c84-2324-4af2-8c2b-fe42135ab2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.431395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b942650-8aa4-40bf-8ceb-8b9cc058a666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.432920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b942650-8aa4-40bf-8ceb-8b9cc058a666 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.440026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b1b19c84-2324-4af2-8c2b-fe42135ab2f5 None None] MFA Rules not processed for user `e997d99ab00441c7a82e175e4f7b960e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:50.441255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b1b19c84-2324-4af2-8c2b-fe42135ab2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:50.446462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 642/1290] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:50.447858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ea9b1-8310-4fac-958b-56550dd32629 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.448160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ea9b1-8310-4fac-958b-56550dd32629 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.448436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ea9b1-8310-4fac-958b-56550dd32629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.469772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-308ea9b1-8310-4fac-958b-56550dd32629 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:50.471038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-308ea9b1-8310-4fac-958b-56550dd32629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:50.480795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 643/1291] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:50.482148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bbbc9-e424-45d1-bc43-7f26b3e139f8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.482606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bbbc9-e424-45d1-bc43-7f26b3e139f8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.482971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bbbc9-e424-45d1-bc43-7f26b3e139f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.505136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e71bbbc9-e424-45d1-bc43-7f26b3e139f8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:50.506728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e71bbbc9-e424-45d1-bc43-7f26b3e139f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:50.511907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:50.519327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 649/1292] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:50.520694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b028-569c-4f8b-a277-e705a610f536 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.520980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b028-569c-4f8b-a277-e705a610f536 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.521294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b028-569c-4f8b-a277-e705a610f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.522822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 644/1293] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:50.524317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5aa9b-46b3-49fa-afa6-5d622fbdc840 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.524653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5aa9b-46b3-49fa-afa6-5d622fbdc840 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.524883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5aa9b-46b3-49fa-afa6-5d622fbdc840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.559685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6000b028-569c-4f8b-a277-e705a610f536 None None] MFA Rules not processed for user `ddf163d4b0a1468e903ca33b69247d47`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:50.561137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6000b028-569c-4f8b-a277-e705a610f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:50.567036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-eaf5aa9b-46b3-49fa-afa6-5d622fbdc840 None None] MFA Rules not processed for user `0aa6e52d7dc64fdfb30240cee508a82d`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:50.569666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-eaf5aa9b-46b3-49fa-afa6-5d622fbdc840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:50.653416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 650/1294] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:50.658888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b028-569c-4f8b-a277-e705a610f536 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.658888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6000b028-569c-4f8b-a277-e705a610f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:50.672532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b028-569c-4f8b-a277-e705a610f536 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.678763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fe2a2-04df-4d9b-ba3c-6a587abdaa8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.679367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fe2a2-04df-4d9b-ba3c-6a587abdaa8c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.679719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fe2a2-04df-4d9b-ba3c-6a587abdaa8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.680062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fe2a2-04df-4d9b-ba3c-6a587abdaa8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.706440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fe2a2-04df-4d9b-ba3c-6a587abdaa8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.708649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fe2a2-04df-4d9b-ba3c-6a587abdaa8c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.710728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 645/1295] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:50.711702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5aa9b-46b3-49fa-afa6-5d622fbdc840 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.721259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 651/1296] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:50.722053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fe2a2-04df-4d9b-ba3c-6a587abdaa8c service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.734080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fe2a2-04df-4d9b-ba3c-6a587abdaa8c service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.747228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d706c2-d48c-48ef-af01-5476ed95019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.749586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d706c2-d48c-48ef-af01-5476ed95019c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.750362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d706c2-d48c-48ef-af01-5476ed95019c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.750786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d706c2-d48c-48ef-af01-5476ed95019c admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.751617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d706c2-d48c-48ef-af01-5476ed95019c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.752336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5aa9b-46b3-49fa-afa6-5d622fbdc840 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.754270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d706c2-d48c-48ef-af01-5476ed95019c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.764219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cabd7-00c2-466d-af8f-698334f25f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.764849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cabd7-00c2-466d-af8f-698334f25f70 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.765694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cabd7-00c2-466d-af8f-698334f25f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.765979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cabd7-00c2-466d-af8f-698334f25f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.793523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cabd7-00c2-466d-af8f-698334f25f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:50.793764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cabd7-00c2-466d-af8f-698334f25f70 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:50.804454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 652/1297] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:50 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:50.804454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d706c2-d48c-48ef-af01-5476ed95019c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.805525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:50.822849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 646/1298] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:50.824172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb54b0d-0ec9-4fea-a9fd-c026792bc80c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.824596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb54b0d-0ec9-4fea-a9fd-c026792bc80c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.824877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb54b0d-0ec9-4fea-a9fd-c026792bc80c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.829254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 647/1299] 10.222.0.27 () {54 vars in 961 bytes} [Mon Oct 10 16:58:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:58:50.834572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb54b0d-0ec9-4fea-a9fd-c026792bc80c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:50.924329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d706c2-d48c-48ef-af01-5476ed95019c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:50.928932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6337-1dcf-436d-90cc-dad5b5cb56d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:50.929823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6337-1dcf-436d-90cc-dad5b5cb56d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:50.930365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6337-1dcf-436d-90cc-dad5b5cb56d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:50.931301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6337-1dcf-436d-90cc-dad5b5cb56d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:50.991874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb54b0d-0ec9-4fea-a9fd-c026792bc80c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:51.005946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c07842-d4e4-4b34-9a2c-426a7e14c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:51.008498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c07842-d4e4-4b34-9a2c-426a7e14c867 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.008782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c07842-d4e4-4b34-9a2c-426a7e14c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.009057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c07842-d4e4-4b34-9a2c-426a7e14c867 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.011481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c07842-d4e4-4b34-9a2c-426a7e14c867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:51.017388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c07842-d4e4-4b34-9a2c-426a7e14c867 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:51.056045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f6337-1dcf-436d-90cc-dad5b5cb56d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:51.058745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f6337-1dcf-436d-90cc-dad5b5cb56d3 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:51.064019 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 648/1300] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:50 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:51.066974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2596-3898-4c04-bedc-840bd6c66648 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.067871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2596-3898-4c04-bedc-840bd6c66648 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.068145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2596-3898-4c04-bedc-840bd6c66648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.078146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 653/1301] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:51.085754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6337-1dcf-436d-90cc-dad5b5cb56d3 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:51.102495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:51.112256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6337-1dcf-436d-90cc-dad5b5cb56d3 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:51.116968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-497b2596-3898-4c04-bedc-840bd6c66648 None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:51.118157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-497b2596-3898-4c04-bedc-840bd6c66648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:51.120751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac39d-3cbf-408b-a629-ba36d9f16157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:51.121752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac39d-3cbf-408b-a629-ba36d9f16157 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.122284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac39d-3cbf-408b-a629-ba36d9f16157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.122871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac39d-3cbf-408b-a629-ba36d9f16157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.123923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bac39d-3cbf-408b-a629-ba36d9f16157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:51.127089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bac39d-3cbf-408b-a629-ba36d9f16157 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:51.141956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 654/1302] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:51.147002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac39d-3cbf-408b-a629-ba36d9f16157 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:51.169156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac39d-3cbf-408b-a629-ba36d9f16157 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:51.184045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a2151-3df9-42ca-975b-7aa07b73c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:51.185334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a2151-3df9-42ca-975b-7aa07b73c33b admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.186149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a2151-3df9-42ca-975b-7aa07b73c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.187670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a2151-3df9-42ca-975b-7aa07b73c33b admin admin] PATH_INFO: `/v3/projects/6e99b166222f4846be7498896d902a37/users/6f1efc1306c947c088ce75199c526282/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.215070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a2151-3df9-42ca-975b-7aa07b73c33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e99b166222f4846be7498896d902a37, user_id=6f1efc1306c947c088ce75199c526282, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:51.220813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a2151-3df9-42ca-975b-7aa07b73c33b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:51.243576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 655/1303] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:51 2022] PUT /identity/v3/projects/6e99b166222f4846be7498896d902a37/users/6f1efc1306c947c088ce75199c526282/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:58:51.247632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a2151-3df9-42ca-975b-7aa07b73c33b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:51.251978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 649/1304] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Oct 10 16:58:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:51.257548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b2596-3898-4c04-bedc-840bd6c66648 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:51.282200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b2596-3898-4c04-bedc-840bd6c66648 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:51.422914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a2151-3df9-42ca-975b-7aa07b73c33b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:51.428748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6cf0e-f8dd-4c06-b091-3953000e4000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:51.429652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6cf0e-f8dd-4c06-b091-3953000e4000 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.430105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6cf0e-f8dd-4c06-b091-3953000e4000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.430586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6cf0e-f8dd-4c06-b091-3953000e4000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.431391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6cf0e-f8dd-4c06-b091-3953000e4000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:51.433515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6cf0e-f8dd-4c06-b091-3953000e4000 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:51.438540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066b4d7-5597-49ec-82e5-bf56f195ac31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:51.439146 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066b4d7-5597-49ec-82e5-bf56f195ac31 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.439430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066b4d7-5597-49ec-82e5-bf56f195ac31 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.439844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066b4d7-5597-49ec-82e5-bf56f195ac31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.449738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 656/1305] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:51.450907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6cf0e-f8dd-4c06-b091-3953000e4000 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:51.464929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:51.466894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6cf0e-f8dd-4c06-b091-3953000e4000 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:51.474992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9d63-c541-412f-bd04-f70a3742b2d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:51.477016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9d63-c541-412f-bd04-f70a3742b2d5 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.478032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9d63-c541-412f-bd04-f70a3742b2d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.478448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9d63-c541-412f-bd04-f70a3742b2d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.527347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066b4d7-5597-49ec-82e5-bf56f195ac31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:51.530459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066b4d7-5597-49ec-82e5-bf56f195ac31 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:51.545069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 650/1306] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:51.548941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066b4d7-5597-49ec-82e5-bf56f195ac31 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:51.559868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066b4d7-5597-49ec-82e5-bf56f195ac31 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:51.566079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9723e-d7dc-4d53-99ce-de0cf4de49f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:51.567547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9723e-d7dc-4d53-99ce-de0cf4de49f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.568921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9723e-d7dc-4d53-99ce-de0cf4de49f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.569493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9723e-d7dc-4d53-99ce-de0cf4de49f5 admin admin] PATH_INFO: `/v3/projects/6e99b166222f4846be7498896d902a37/users/6f1efc1306c947c088ce75199c526282/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.572709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9723e-d7dc-4d53-99ce-de0cf4de49f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e99b166222f4846be7498896d902a37, user_id=6f1efc1306c947c088ce75199c526282, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:51.576170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9723e-d7dc-4d53-99ce-de0cf4de49f5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:51.595678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec9d63-c541-412f-bd04-f70a3742b2d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:51.596006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 651/1307] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:51 2022] PUT /identity/v3/projects/6e99b166222f4846be7498896d902a37/users/6f1efc1306c947c088ce75199c526282/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:51.597465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec9d63-c541-412f-bd04-f70a3742b2d5 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:51.614171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 657/1308] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:51.626741 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45f37-2840-4137-96f0-31707016a19b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.627528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45f37-2840-4137-96f0-31707016a19b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.628555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45f37-2840-4137-96f0-31707016a19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.680183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-fdd45f37-2840-4137-96f0-31707016a19b None None] MFA Rules not processed for user `6f1efc1306c947c088ce75199c526282`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:51.682779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fdd45f37-2840-4137-96f0-31707016a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:51.843328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 652/1309] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:51.864458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9d63-c541-412f-bd04-f70a3742b2d5 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:51.924810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d553-95de-4b9e-a313-0ea960ae6743 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.925106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d553-95de-4b9e-a313-0ea960ae6743 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.925391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d553-95de-4b9e-a313-0ea960ae6743 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:51.927251 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 653/1310] 10.222.0.27 () {54 vars in 912 bytes} [Mon Oct 10 16:58:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:58:51.936599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f2496-b788-4b99-bf80-fa348298cc4d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:51.937450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f2496-b788-4b99-bf80-fa348298cc4d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:51.937871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f2496-b788-4b99-bf80-fa348298cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:52.001781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f50f2496-b788-4b99-bf80-fa348298cc4d None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:52.006795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f50f2496-b788-4b99-bf80-fa348298cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:52.019024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9d63-c541-412f-bd04-f70a3742b2d5 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:52.039009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:52.101295 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88943d3-adf2-4f25-a4ea-bad56b3e6934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:52.102218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88943d3-adf2-4f25-a4ea-bad56b3e6934 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:52.102779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88943d3-adf2-4f25-a4ea-bad56b3e6934 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:52.104556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88943d3-adf2-4f25-a4ea-bad56b3e6934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:52.119796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88943d3-adf2-4f25-a4ea-bad56b3e6934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:52.122582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88943d3-adf2-4f25-a4ea-bad56b3e6934 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:52.160039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 658/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:58:52.176373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 654/1312] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 16:58:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:52.210402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88943d3-adf2-4f25-a4ea-bad56b3e6934 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:52.222830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88943d3-adf2-4f25-a4ea-bad56b3e6934 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:52.234313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bc337-8e7e-46e5-b54d-eca7b3993c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:52.236444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bc337-8e7e-46e5-b54d-eca7b3993c0c service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:52.236805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bc337-8e7e-46e5-b54d-eca7b3993c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:52.238887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bc337-8e7e-46e5-b54d-eca7b3993c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:52.263586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bc337-8e7e-46e5-b54d-eca7b3993c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:52.266019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bc337-8e7e-46e5-b54d-eca7b3993c0c service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:52.292370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 659/1313] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:52.916357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f2496-b788-4b99-bf80-fa348298cc4d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:52.960155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:53.088463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f2496-b788-4b99-bf80-fa348298cc4d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:53.101580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:53.102237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:53.104022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:53.104305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] PATH_INFO: `/v3/users/ddf163d4b0a1468e903ca33b69247d47` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:53.112720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf163d4b0a1468e903ca33b69247d47)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:53.116474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:58:53.116474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 10 16:58:53.116474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: Oct 10 16:58:53.124528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:53.328180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf163d4b0a1468e903ca33b69247d47'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:53.377591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf163d4b0a1468e903ca33b69247d47'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:53.414784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf163d4b0a1468e903ca33b69247d47'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:53.416326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf163d4b0a1468e903ca33b69247d47'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:53.441665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf163d4b0a1468e903ca33b69247d47'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:53.458937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 655/1314] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:58:52 2022] DELETE /identity/v3/users/ddf163d4b0a1468e903ca33b69247d47 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:53.461325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430abd-ca83-4789-94a8-17a1318d6a60 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:53.461800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430abd-ca83-4789-94a8-17a1318d6a60 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:53.462024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430abd-ca83-4789-94a8-17a1318d6a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:53.512668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-79430abd-ca83-4789-94a8-17a1318d6a60 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:53.513973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-79430abd-ca83-4789-94a8-17a1318d6a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:53.704675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 660/1315] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:53.721014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:53.722482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:53.775895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79430abd-ca83-4789-94a8-17a1318d6a60 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:53.777655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-79430abd-ca83-4789-94a8-17a1318d6a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:53.820954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79430abd-ca83-4789-94a8-17a1318d6a60 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:53.826859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:53.827573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:53.827846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:53.828117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] PATH_INFO: `/v3/users/e997d99ab00441c7a82e175e4f7b960e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:53.829296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e997d99ab00441c7a82e175e4f7b960e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:53.832222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:53.916012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbec788-0577-4aef-9d27-52f82310b075 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:53.925844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3d3d3-07ca-4ba1-832b-9554c26f8177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:53.927665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3d3d3-07ca-4ba1-832b-9554c26f8177 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:53.928306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3d3d3-07ca-4ba1-832b-9554c26f8177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:53.929970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3d3d3-07ca-4ba1-832b-9554c26f8177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:53.935413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e997d99ab00441c7a82e175e4f7b960e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:53.936108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e997d99ab00441c7a82e175e4f7b960e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:53.955553 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e997d99ab00441c7a82e175e4f7b960e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:53.967657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3d3d3-07ca-4ba1-832b-9554c26f8177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:53.978401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3d3d3-07ca-4ba1-832b-9554c26f8177 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:53.999777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e997d99ab00441c7a82e175e4f7b960e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:54.000556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e997d99ab00441c7a82e175e4f7b960e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:54.003716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 656/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:54.021847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 661/1317] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:58:53 2022] DELETE /identity/v3/users/e997d99ab00441c7a82e175e4f7b960e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:54.026002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dea74-1021-453c-ba41-304f38098e51 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:54.026704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dea74-1021-453c-ba41-304f38098e51 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:54.027215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dea74-1021-453c-ba41-304f38098e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:54.064671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a79dea74-1021-453c-ba41-304f38098e51 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:54.067663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a79dea74-1021-453c-ba41-304f38098e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:54.128841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:54.165299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 657/1318] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:54.241338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:54.243104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:54.290013 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:54.427210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9b788-396d-4e39-b1f0-dab9f5f95ad2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:54.434054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0bdba-7313-4289-947e-b4289634fb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:54.436416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0bdba-7313-4289-947e-b4289634fb9e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:54.437831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0bdba-7313-4289-947e-b4289634fb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:54.438378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0bdba-7313-4289-947e-b4289634fb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:54.461767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0bdba-7313-4289-947e-b4289634fb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:54.463673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0bdba-7313-4289-947e-b4289634fb9e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:54.479083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 662/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:55.162663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dea74-1021-453c-ba41-304f38098e51 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:55.166682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a79dea74-1021-453c-ba41-304f38098e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:55.184581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dea74-1021-453c-ba41-304f38098e51 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:55.196346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:55.197005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:55.197282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:55.200322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] PATH_INFO: `/v3/users/0aa6e52d7dc64fdfb30240cee508a82d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:55.205517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa6e52d7dc64fdfb30240cee508a82d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:55.207598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:55.353824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa6e52d7dc64fdfb30240cee508a82d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:55.389026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa6e52d7dc64fdfb30240cee508a82d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:55.412853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa6e52d7dc64fdfb30240cee508a82d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:55.414120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa6e52d7dc64fdfb30240cee508a82d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:55.435387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa6e52d7dc64fdfb30240cee508a82d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:55.449067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 658/1320] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:58:55 2022] DELETE /identity/v3/users/0aa6e52d7dc64fdfb30240cee508a82d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:55.460320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8b07-6ae9-4f77-b7e5-f866a57bfa3d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:55.460609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8b07-6ae9-4f77-b7e5-f866a57bfa3d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:55.460893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8b07-6ae9-4f77-b7e5-f866a57bfa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:55.497583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9f7f8b07-6ae9-4f77-b7e5-f866a57bfa3d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:55.499909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9f7f8b07-6ae9-4f77-b7e5-f866a57bfa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:55.649238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 663/1321] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:55.685136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:55.687170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:55.807710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc717d6-aa1e-4ccc-9bfb-c0281319a95f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:55.829993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec4690-57fc-4360-b46f-9d3298efd72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:55.834442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec4690-57fc-4360-b46f-9d3298efd72e service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:55.834800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec4690-57fc-4360-b46f-9d3298efd72e service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:55.835235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec4690-57fc-4360-b46f-9d3298efd72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:55.863439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec4690-57fc-4360-b46f-9d3298efd72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:55.868456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec4690-57fc-4360-b46f-9d3298efd72e service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:55.908641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 659/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:56.179382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f8b07-6ae9-4f77-b7e5-f866a57bfa3d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:56.180969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9f7f8b07-6ae9-4f77-b7e5-f866a57bfa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:56.214856 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f8b07-6ae9-4f77-b7e5-f866a57bfa3d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:56.222838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:56.224145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:56.224609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:56.224968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] PATH_INFO: `/v3/projects/c36e8e400d8f4a6288078bd8b2a9b889` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:56.226413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36e8e400d8f4a6288078bd8b2a9b889)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:56.227826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 16:58:56.227826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 10 16:58:56.227826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: Oct 10 16:58:56.229274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:56.399388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36e8e400d8f4a6288078bd8b2a9b889', 'request_id': 'req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:56.433918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36e8e400d8f4a6288078bd8b2a9b889', 'request_id': 'req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:56.459398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36e8e400d8f4a6288078bd8b2a9b889', 'request_id': 'req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:56.487357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] The token cache is being invalidate because project c36e8e400d8f4a6288078bd8b2a9b889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:58:56.487736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:56.488650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4647a16f-18e3-4f3e-9bf6-4cca47cd65dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:56.498829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 664/1323] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:58:56 2022] DELETE /identity/v3/projects/c36e8e400d8f4a6288078bd8b2a9b889 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:56.504272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef657-f859-4070-a90a-7b89265a191c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:56.504839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef657-f859-4070-a90a-7b89265a191c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:56.504839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef657-f859-4070-a90a-7b89265a191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:56.569626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7e4ef657-f859-4070-a90a-7b89265a191c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:56.571325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7e4ef657-f859-4070-a90a-7b89265a191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:56.715623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:56.747882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 660/1324] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:56.756122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d100c-3144-42ac-bf8c-4dfb62a95335 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:56.756759 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d100c-3144-42ac-bf8c-4dfb62a95335 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:56.757210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d100c-3144-42ac-bf8c-4dfb62a95335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:56.801375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-620d100c-3144-42ac-bf8c-4dfb62a95335 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:56.806759 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-620d100c-3144-42ac-bf8c-4dfb62a95335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:56.833007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 665/1325] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:56.837255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef657-f859-4070-a90a-7b89265a191c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:56.852865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef657-f859-4070-a90a-7b89265a191c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:56.866476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:56.867396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:56.869421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:56.869862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:56.870715 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:56.871180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:56.874303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:56.908919 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 661/1326] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:56.913071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d100c-3144-42ac-bf8c-4dfb62a95335 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:56.924097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d100c-3144-42ac-bf8c-4dfb62a95335 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:56.944505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:56.945223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:56.945716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:56.946173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:56.947036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:56.949784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:57.046668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 666/1327] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:56 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:57.050856 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:57.063133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135049-730f-4b74-bcc5-418704b4c53e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:57.156547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:57.158766 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:57.166770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aceab6-aca1-42ae-a64e-16c88b85d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:57.168111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aceab6-aca1-42ae-a64e-16c88b85d228 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:57.173113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aceab6-aca1-42ae-a64e-16c88b85d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:57.173238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aceab6-aca1-42ae-a64e-16c88b85d228 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:57.173924 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aceab6-aca1-42ae-a64e-16c88b85d228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:57.183430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aceab6-aca1-42ae-a64e-16c88b85d228 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:57.192823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7724bc-d854-4b2f-9611-c02836f4707b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:57.221199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:57.221694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:57.222044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:57.222263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] PATH_INFO: `/v3/projects/e5340bac0fcf4c2994b03e03974de722` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:57.224415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5340bac0fcf4c2994b03e03974de722)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:57.226353 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:57.247553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 662/1328] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:57 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:57.252349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aceab6-aca1-42ae-a64e-16c88b85d228 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:57.265882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:57.277851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aceab6-aca1-42ae-a64e-16c88b85d228 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:57.291232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6c9e6-2714-402b-9fe5-c0d7311c5897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:57.293442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6c9e6-2714-402b-9fe5-c0d7311c5897 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:57.293827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6c9e6-2714-402b-9fe5-c0d7311c5897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:57.294079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6c9e6-2714-402b-9fe5-c0d7311c5897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:57.295183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6c9e6-2714-402b-9fe5-c0d7311c5897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:57.299422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6c9e6-2714-402b-9fe5-c0d7311c5897 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:57.332053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 663/1329] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:57.334640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6c9e6-2714-402b-9fe5-c0d7311c5897 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:57.346880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5340bac0fcf4c2994b03e03974de722', 'request_id': 'req-d4155dfc-b099-42d1-a48b-908f422d9beb'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:57.359085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6c9e6-2714-402b-9fe5-c0d7311c5897 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:57.365655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5340bac0fcf4c2994b03e03974de722', 'request_id': 'req-d4155dfc-b099-42d1-a48b-908f422d9beb'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:57.379403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5340bac0fcf4c2994b03e03974de722', 'request_id': 'req-d4155dfc-b099-42d1-a48b-908f422d9beb'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:57.426120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] The token cache is being invalidate because project e5340bac0fcf4c2994b03e03974de722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:58:57.427130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:57.429543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d4155dfc-b099-42d1-a48b-908f422d9beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:57.434617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 667/1330] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:58:57 2022] DELETE /identity/v3/projects/e5340bac0fcf4c2994b03e03974de722 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:57.440314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53d95-25ed-4cde-bb6a-bf01a08bc366 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:57.440868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53d95-25ed-4cde-bb6a-bf01a08bc366 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:57.441328 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53d95-25ed-4cde-bb6a-bf01a08bc366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:57.529388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6fe53d95-25ed-4cde-bb6a-bf01a08bc366 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:57.535815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6fe53d95-25ed-4cde-bb6a-bf01a08bc366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:57.600811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:57.601439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:57.601890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:57.602420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:57.603414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:57.611167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:57.663513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 664/1331] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:57.666219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:57.669976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:57.708173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f428-2eac-4354-990d-3071e52b41b3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:57.729619 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:57.730271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:57.733367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:57.734495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] PATH_INFO: `/v3/users/7f9861341d2543b4bb41b3b4c5c9bd2f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:57.736788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9861341d2543b4bb41b3b4c5c9bd2f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:57.744962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:57.763071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 668/1332] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:58:57.764384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe53d95-25ed-4cde-bb6a-bf01a08bc366 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:57.769830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6fe53d95-25ed-4cde-bb6a-bf01a08bc366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:57.796396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe53d95-25ed-4cde-bb6a-bf01a08bc366 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:57.809579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730886-8bbb-4745-9a56-c79d84119611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:57.810240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730886-8bbb-4745-9a56-c79d84119611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:57.810602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730886-8bbb-4745-9a56-c79d84119611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:57.810819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730886-8bbb-4745-9a56-c79d84119611 admin admin] PATH_INFO: `/v3/projects/add625f1f39e4de49ace5092a14ba8a2/users/668bfc423ee8479abf3d7791917f13c7/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:57.858252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730886-8bbb-4745-9a56-c79d84119611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=add625f1f39e4de49ace5092a14ba8a2, user_id=668bfc423ee8479abf3d7791917f13c7, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:57.865148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730886-8bbb-4745-9a56-c79d84119611 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:57.903666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9861341d2543b4bb41b3b4c5c9bd2f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:57.917219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 669/1333] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:57 2022] PUT /identity/v3/projects/add625f1f39e4de49ace5092a14ba8a2/users/668bfc423ee8479abf3d7791917f13c7/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:57.918747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:57.920269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e56c7-1600-4dc0-973f-9841b67b7cb8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:57.922422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e56c7-1600-4dc0-973f-9841b67b7cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:57.922877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e56c7-1600-4dc0-973f-9841b67b7cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:57.951884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9861341d2543b4bb41b3b4c5c9bd2f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:57.966873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ad8e56c7-1600-4dc0-973f-9841b67b7cb8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:57.968847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9861341d2543b4bb41b3b4c5c9bd2f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:57.971567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ad8e56c7-1600-4dc0-973f-9841b67b7cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:57.973167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9861341d2543b4bb41b3b4c5c9bd2f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:58.001556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ad1151e-7e26-43a5-8eec-5f9a1d57509a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9861341d2543b4bb41b3b4c5c9bd2f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:58.012043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 665/1334] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:58:57 2022] DELETE /identity/v3/users/7f9861341d2543b4bb41b3b4c5c9bd2f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:58.012043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602225-35a2-42c0-a1eb-eb0ff4e73499 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:58.012043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602225-35a2-42c0-a1eb-eb0ff4e73499 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:58.012043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602225-35a2-42c0-a1eb-eb0ff4e73499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:58.098801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a9602225-35a2-42c0-a1eb-eb0ff4e73499 None None] MFA Rules not processed for user `668bfc423ee8479abf3d7791917f13c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:58.100053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a9602225-35a2-42c0-a1eb-eb0ff4e73499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:58.112268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 670/1335] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:58.115882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52deef6-3845-4106-85eb-721a0bbfb727 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:58.115882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52deef6-3845-4106-85eb-721a0bbfb727 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:58.115882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52deef6-3845-4106-85eb-721a0bbfb727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:58.167465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a52deef6-3845-4106-85eb-721a0bbfb727 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:58:58.168980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a52deef6-3845-4106-85eb-721a0bbfb727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:58.203607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:58.253404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 666/1336] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:58.254839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9602225-35a2-42c0-a1eb-eb0ff4e73499 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:58.321089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 671/1337] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:58:58.322123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52deef6-3845-4106-85eb-721a0bbfb727 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:58.326881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a52deef6-3845-4106-85eb-721a0bbfb727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:58.354907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52deef6-3845-4106-85eb-721a0bbfb727 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:58.367009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:58.368099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:58.368368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:58.370479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:58.371903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:58.376363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:58.407334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9602225-35a2-42c0-a1eb-eb0ff4e73499 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:58.417635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:58.419041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:58.419327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:58.419605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:58.420421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:58:58.420731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:58.423150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:58.442428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 672/1338] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:58 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:58.443159 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:58.449989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:58.460925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 667/1339] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:58:58.462195 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:58.483249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2e54-86cd-4bd0-92ef-7cdcf9be68df admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:58.597064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ef4a-d7cb-4e13-986f-a3ad6ef83969 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:58.605887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb9e57-3b11-468b-affc-98cd8423c384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:58.606603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9e57-3b11-468b-affc-98cd8423c384 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:58.606832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9e57-3b11-468b-affc-98cd8423c384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:58.607499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9e57-3b11-468b-affc-98cd8423c384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:58.621599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:58.644461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524dc14-685a-4704-ac8e-523ce1f48b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:58.645149 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524dc14-685a-4704-ac8e-523ce1f48b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:58.645429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524dc14-685a-4704-ac8e-523ce1f48b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:58.645702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524dc14-685a-4704-ac8e-523ce1f48b55 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:58.646359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524dc14-685a-4704-ac8e-523ce1f48b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:58.648722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524dc14-685a-4704-ac8e-523ce1f48b55 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:58.713500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 668/1340] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:58 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:58.716542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524dc14-685a-4704-ac8e-523ce1f48b55 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:58.738902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524dc14-685a-4704-ac8e-523ce1f48b55 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:58.753900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:58.754530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:58.756067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:58.756344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:58.756984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:58.762508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:58.777623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb9e57-3b11-468b-affc-98cd8423c384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:58.779128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb9e57-3b11-468b-affc-98cd8423c384 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:58.810429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 673/1341] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:58:58.811946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb9e57-3b11-468b-affc-98cd8423c384 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:58.834144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 669/1342] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:58:58 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:58.836305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:58.850575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:58.854478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb9e57-3b11-468b-affc-98cd8423c384 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:58.961649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:58.986847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73586a-562e-4c9c-9b1f-04e81c6f36c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:58.987714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73586a-562e-4c9c-9b1f-04e81c6f36c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:58.988096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73586a-562e-4c9c-9b1f-04e81c6f36c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:58.988445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73586a-562e-4c9c-9b1f-04e81c6f36c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:58.989371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73586a-562e-4c9c-9b1f-04e81c6f36c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:58.991778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73586a-562e-4c9c-9b1f-04e81c6f36c5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.015226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 674/1343] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:59.016525 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73586a-562e-4c9c-9b1f-04e81c6f36c5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:59.029022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73586a-562e-4c9c-9b1f-04e81c6f36c5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:59.029183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24f4eb-42d9-439e-a07d-0c18b413ba81 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:59.050076 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:59.050781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.050921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d3e36-0f9d-4f03-abad-f010654f9d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:59.051125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.051387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] PATH_INFO: `/v3/projects/8d0b29d7d845487b921e7559db108e5c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:59.051510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d3e36-0f9d-4f03-abad-f010654f9d66 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.051818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d3e36-0f9d-4f03-abad-f010654f9d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.054738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0b29d7d845487b921e7559db108e5c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:59.056822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d3e36-0f9d-4f03-abad-f010654f9d66 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:59.057651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.066974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d3e36-0f9d-4f03-abad-f010654f9d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:59.069506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d3e36-0f9d-4f03-abad-f010654f9d66 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.117762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 675/1344] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:58:59 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:58:59.118550 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d3e36-0f9d-4f03-abad-f010654f9d66 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:59.133522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d3e36-0f9d-4f03-abad-f010654f9d66 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:59.176938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0b29d7d845487b921e7559db108e5c', 'request_id': 'req-3c227e88-641a-440d-9994-3636cf4b954c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.190552 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0b29d7d845487b921e7559db108e5c', 'request_id': 'req-3c227e88-641a-440d-9994-3636cf4b954c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.213060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0b29d7d845487b921e7559db108e5c', 'request_id': 'req-3c227e88-641a-440d-9994-3636cf4b954c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.243143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] The token cache is being invalidate because project 8d0b29d7d845487b921e7559db108e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:58:59.243492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.246350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.251173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 670/1345] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:58:58 2022] DELETE /identity/v3/projects/8d0b29d7d845487b921e7559db108e5c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:59.252104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:59.259425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:59.285554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:59.302348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.302922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.303366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] PATH_INFO: `/v3/projects/55a040ccad1949d79c93e29c86f9b5fa/users/629904494dc34b78866b771228100b93/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:59.356623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a040ccad1949d79c93e29c86f9b5fa, user_id=629904494dc34b78866b771228100b93, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:59.361953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.363249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:59.402227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 676/1346] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:59 2022] PUT /identity/v3/projects/55a040ccad1949d79c93e29c86f9b5fa/users/629904494dc34b78866b771228100b93/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:59.404579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227e88-641a-440d-9994-3636cf4b954c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:59.406935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:59.409280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:59.539084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:59.539938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.540329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.540705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:59.541470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:59.543235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.557825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6038e-4326-4fa1-8c1b-003d88102456 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:59.570938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 671/1347] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:59.572341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:59.576678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:59.592051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:59.593749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.594452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.595555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] PATH_INFO: `/v3/users/6f1efc1306c947c088ce75199c526282` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:59.615090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1efc1306c947c088ce75199c526282)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:59.627231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.648220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10b35-84f7-4a24-bf18-f4be86f2afa1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:59.667813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849bba5-1317-43ee-89a7-9a51c8773b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:59.709298 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bba5-1317-43ee-89a7-9a51c8773b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.711953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bba5-1317-43ee-89a7-9a51c8773b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.712495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bba5-1317-43ee-89a7-9a51c8773b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:59.715167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849bba5-1317-43ee-89a7-9a51c8773b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:59.723118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849bba5-1317-43ee-89a7-9a51c8773b83 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.757247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 672/1348] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:59.759081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849bba5-1317-43ee-89a7-9a51c8773b83 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:59.774712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849bba5-1317-43ee-89a7-9a51c8773b83 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:59.793596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2bb7-130e-4bde-a06f-0f80fc84f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:59.794388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2bb7-130e-4bde-a06f-0f80fc84f02f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.794990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2bb7-130e-4bde-a06f-0f80fc84f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.795474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2bb7-130e-4bde-a06f-0f80fc84f02f admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:59.796772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1efc1306c947c088ce75199c526282'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.796903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca2bb7-130e-4bde-a06f-0f80fc84f02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:59.797972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1efc1306c947c088ce75199c526282'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.804615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca2bb7-130e-4bde-a06f-0f80fc84f02f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.808616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:58:59.833387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 673/1349] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:58:59.834769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2bb7-130e-4bde-a06f-0f80fc84f02f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:59.852889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2bb7-130e-4bde-a06f-0f80fc84f02f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:58:59.853371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1efc1306c947c088ce75199c526282'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.876180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:58:59.877068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.877742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.878112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] PATH_INFO: `/v3/projects/55a040ccad1949d79c93e29c86f9b5fa/users/629904494dc34b78866b771228100b93/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:58:59.888592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a040ccad1949d79c93e29c86f9b5fa, user_id=629904494dc34b78866b771228100b93, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:58:59.899306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:58:59.928176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1efc1306c947c088ce75199c526282'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.929242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-365c8a9d-ca5e-4c9b-a9c8-77b7170c4c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1efc1306c947c088ce75199c526282'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:58:59.946761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 674/1350] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:59 2022] PUT /identity/v3/projects/55a040ccad1949d79c93e29c86f9b5fa/users/629904494dc34b78866b771228100b93/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:59.962187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:58:59.966285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 677/1351] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:58:59 2022] DELETE /identity/v3/users/6f1efc1306c947c088ce75199c526282 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:58:59.968364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:58:59.970139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4bc5-889d-4159-9b27-7487d3b4a183 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:58:59.972619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4bc5-889d-4159-9b27-7487d3b4a183 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:58:59.975416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4bc5-889d-4159-9b27-7487d3b4a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:00.119557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a36c4bc5-889d-4159-9b27-7487d3b4a183 None None] MFA Rules not processed for user `629904494dc34b78866b771228100b93`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:00.120731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a36c4bc5-889d-4159-9b27-7487d3b4a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:00.173887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af7b46-6dd2-4694-b2d4-0a1f43ed0a8b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:00.342441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 678/1352] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:00.354455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c4bc5-889d-4159-9b27-7487d3b4a183 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:00.356256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a36c4bc5-889d-4159-9b27-7487d3b4a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:00.374685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278569f2-3081-4da9-8774-17b4e975a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:00.375306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278569f2-3081-4da9-8774-17b4e975a3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:00.375593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278569f2-3081-4da9-8774-17b4e975a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:00.375867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278569f2-3081-4da9-8774-17b4e975a3c4 admin admin] PATH_INFO: `/v3/projects/b9f7880939c849068128f391a2d8ec5b/users/72848f2ce38647cb964bdc7529f70014/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:00.411920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:00.429822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278569f2-3081-4da9-8774-17b4e975a3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f7880939c849068128f391a2d8ec5b, user_id=72848f2ce38647cb964bdc7529f70014, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:00.430972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278569f2-3081-4da9-8774-17b4e975a3c4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:00.474452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 675/1353] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:58:59 2022] PUT /identity/v3/projects/b9f7880939c849068128f391a2d8ec5b/users/72848f2ce38647cb964bdc7529f70014/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:00.489599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49bdae-7934-488b-b649-bd5b8f6b6b6a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:00.489899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49bdae-7934-488b-b649-bd5b8f6b6b6a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:00.492837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49bdae-7934-488b-b649-bd5b8f6b6b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:00.563644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c4bc5-889d-4159-9b27-7487d3b4a183 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:00.606696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-3c49bdae-7934-488b-b649-bd5b8f6b6b6a None None] MFA Rules not processed for user `72848f2ce38647cb964bdc7529f70014`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:00.633438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3c49bdae-7934-488b-b649-bd5b8f6b6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:00.809077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeed2f-0e72-4e96-9ddd-de8a1dcb0e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:00.809709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeed2f-0e72-4e96-9ddd-de8a1dcb0e32 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:00.809967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeed2f-0e72-4e96-9ddd-de8a1dcb0e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:00.810585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 676/1354] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:00.812383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49bdae-7934-488b-b649-bd5b8f6b6b6a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:00.813898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeed2f-0e72-4e96-9ddd-de8a1dcb0e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:00.818632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3c49bdae-7934-488b-b649-bd5b8f6b6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:00.876809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:00.978178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeed2f-0e72-4e96-9ddd-de8a1dcb0e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:00.979533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeed2f-0e72-4e96-9ddd-de8a1dcb0e32 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:01.008034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 679/1355] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:59:01.018264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e5a85-1b7a-4af4-ae3a-55da07e0b07f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.018659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e5a85-1b7a-4af4-ae3a-55da07e0b07f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.019024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e5a85-1b7a-4af4-ae3a-55da07e0b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.022592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49bdae-7934-488b-b649-bd5b8f6b6b6a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:01.037141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:01.038350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.038350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.038595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] PATH_INFO: `/v3/projects/7be9eb4c93a14498a58bedab2bb24736` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.040240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be9eb4c93a14498a58bedab2bb24736)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:01.048524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:01.089453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-491e5a85-1b7a-4af4-ae3a-55da07e0b07f None None] MFA Rules not processed for user `4e66774737b5439d8b615cbb271f1faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:01.098375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-491e5a85-1b7a-4af4-ae3a-55da07e0b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:01.200478 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be9eb4c93a14498a58bedab2bb24736', 'request_id': 'req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:01.224477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be9eb4c93a14498a58bedab2bb24736', 'request_id': 'req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:01.245330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be9eb4c93a14498a58bedab2bb24736', 'request_id': 'req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:01.286824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] The token cache is being invalidate because project 7be9eb4c93a14498a58bedab2bb24736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:01.287171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:01.289480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:01.295068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 677/1356] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:00 2022] DELETE /identity/v3/projects/7be9eb4c93a14498a58bedab2bb24736 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:01.295068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:01.295068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:01.303551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 680/1357] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:01.307348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb01e99-717a-4f75-92d8-287fc7bf5e99 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.307644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb01e99-717a-4f75-92d8-287fc7bf5e99 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.307929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb01e99-717a-4f75-92d8-287fc7bf5e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.336633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:01.379488 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9fb01e99-717a-4f75-92d8-287fc7bf5e99 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:01.380815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9fb01e99-717a-4f75-92d8-287fc7bf5e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:01.495659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660fd42-60f0-45a5-8605-6f0eee8fbb7a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:01.507241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a58c1-a829-4445-b708-82e0d8864191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:01.507874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a58c1-a829-4445-b708-82e0d8864191 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.508156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a58c1-a829-4445-b708-82e0d8864191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.508434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a58c1-a829-4445-b708-82e0d8864191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.509092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a58c1-a829-4445-b708-82e0d8864191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:01.516313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a58c1-a829-4445-b708-82e0d8864191 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:01.557964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 681/1358] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:01.559395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed6ba6-0e4b-4842-ac81-dd36b6bebe0c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.559692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed6ba6-0e4b-4842-ac81-dd36b6bebe0c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.559969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed6ba6-0e4b-4842-ac81-dd36b6bebe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.590625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 678/1359] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:01 2022] POST /identity/v3/projects => generated 369 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:01.590625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2482ef-fe53-4f48-aa59-486c927f6574 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.590625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2482ef-fe53-4f48-aa59-486c927f6574 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.590625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2482ef-fe53-4f48-aa59-486c927f6574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.604690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f6ed6ba6-0e4b-4842-ac81-dd36b6bebe0c None None] MFA Rules not processed for user `4e66774737b5439d8b615cbb271f1faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:01.604690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f6ed6ba6-0e4b-4842-ac81-dd36b6bebe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:01.623074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0c2482ef-fe53-4f48-aa59-486c927f6574 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:01.624945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0c2482ef-fe53-4f48-aa59-486c927f6574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:01.734073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:01.761187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 679/1360] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:01.761187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2482ef-fe53-4f48-aa59-486c927f6574 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:01.762102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 682/1361] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:01.766307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed6ba6-0e4b-4842-ac81-dd36b6bebe0c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:01.782398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2482ef-fe53-4f48-aa59-486c927f6574 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:01.789527 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:01.789848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed6ba6-0e4b-4842-ac81-dd36b6bebe0c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:01.790258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.790681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.790962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.792538 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:01.794842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:01.806505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:01.807316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.807642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.807882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.808573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:01.808896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:01.814571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:01.836260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 680/1362] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:01 2022] POST /identity/v3/users => generated 291 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:01.837347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:01.839203 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:01.846784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 683/1363] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:01.847681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:01.882395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2497f91-fc6a-4ed2-a1c1-57d018d91ab8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:01.915951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4014c-e50d-4833-b72d-e21b0880aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:01.916500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4014c-e50d-4833-b72d-e21b0880aabe admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.916783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4014c-e50d-4833-b72d-e21b0880aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.917064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4014c-e50d-4833-b72d-e21b0880aabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:01.917998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4014c-e50d-4833-b72d-e21b0880aabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:01.919682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4014c-e50d-4833-b72d-e21b0880aabe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:01.965658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 684/1364] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:01.969931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4014c-e50d-4833-b72d-e21b0880aabe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:01.990572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4014c-e50d-4833-b72d-e21b0880aabe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:01.997821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cfee9-1f33-4b1c-a33b-6eaa87507417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:01.998440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cfee9-1f33-4b1c-a33b-6eaa87507417 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:01.998776 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cfee9-1f33-4b1c-a33b-6eaa87507417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:01.999227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cfee9-1f33-4b1c-a33b-6eaa87507417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.011018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cfee9-1f33-4b1c-a33b-6eaa87507417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.013758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cfee9-1f33-4b1c-a33b-6eaa87507417 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.063951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0748b-07f9-4718-b228-fb3924d42467 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:02.073764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:02.075670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.077996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.082271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.085944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 685/1365] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:01 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:02.086985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cfee9-1f33-4b1c-a33b-6eaa87507417 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:02.090304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:02.115691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.117585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.143089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 681/1366] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:02.147094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:02.159357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:02.168035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffcfb3-2398-4dbe-a632-87cccbd57162 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:02.299972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cfee9-1f33-4b1c-a33b-6eaa87507417 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:02.321157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:02.323166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200850-4729-4d94-909e-807f96286901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:02.324020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200850-4729-4d94-909e-807f96286901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.324487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200850-4729-4d94-909e-807f96286901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.324930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200850-4729-4d94-909e-807f96286901 admin admin] PATH_INFO: `/v3/projects/795adf1df20247409670ee6f799df1f4/users/10ce34ccca18444abd3fc012af3c03c9/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.325163 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.325484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.325765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.326495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.328759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.375042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b200850-4729-4d94-909e-807f96286901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795adf1df20247409670ee6f799df1f4, user_id=10ce34ccca18444abd3fc012af3c03c9, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.378062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b200850-4729-4d94-909e-807f96286901 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.383365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 682/1367] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:02 2022] POST /identity/v3/users => generated 282 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:02.383365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:02.387390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:02.415320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd30f-e88d-4032-9801-97e1cc3b5885 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:02.416208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 686/1368] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:02 2022] PUT /identity/v3/projects/795adf1df20247409670ee6f799df1f4/users/10ce34ccca18444abd3fc012af3c03c9/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:02.417144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200850-4729-4d94-909e-807f96286901 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:02.557649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200850-4729-4d94-909e-807f96286901 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:02.566959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:02.567618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.567902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.568183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] PATH_INFO: `/v3/users/668bfc423ee8479abf3d7791917f13c7` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.569342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=668bfc423ee8479abf3d7791917f13c7)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.571389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.573214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02afb-ceeb-4411-b1c6-56f0901ea53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:02.573914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02afb-ceeb-4411-b1c6-56f0901ea53e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.574237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02afb-ceeb-4411-b1c6-56f0901ea53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.574514 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02afb-ceeb-4411-b1c6-56f0901ea53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.577206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b02afb-ceeb-4411-b1c6-56f0901ea53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.581787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b02afb-ceeb-4411-b1c6-56f0901ea53e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.614438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 687/1369] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:02.616025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02afb-ceeb-4411-b1c6-56f0901ea53e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:02.641376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02afb-ceeb-4411-b1c6-56f0901ea53e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:02.663111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668bfc423ee8479abf3d7791917f13c7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:02.665601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e993-5cf1-4237-96da-0c8728768175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:02.666742 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e993-5cf1-4237-96da-0c8728768175 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.668285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e993-5cf1-4237-96da-0c8728768175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.670040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e993-5cf1-4237-96da-0c8728768175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.671346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23e993-5cf1-4237-96da-0c8728768175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.677028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23e993-5cf1-4237-96da-0c8728768175 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.693929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668bfc423ee8479abf3d7791917f13c7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:02.701134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 688/1370] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:02.706326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e993-5cf1-4237-96da-0c8728768175 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:02.716169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668bfc423ee8479abf3d7791917f13c7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:02.718909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668bfc423ee8479abf3d7791917f13c7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:02.730596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e993-5cf1-4237-96da-0c8728768175 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:02.737429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668bfc423ee8479abf3d7791917f13c7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:02.752875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 683/1371] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:02 2022] DELETE /identity/v3/users/668bfc423ee8479abf3d7791917f13c7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:02.753181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:02.753512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056bc22-60eb-4a82-afc9-4e5897eebae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:02.755190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056bc22-60eb-4a82-afc9-4e5897eebae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.756466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056bc22-60eb-4a82-afc9-4e5897eebae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.757403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:02.757856 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056bc22-60eb-4a82-afc9-4e5897eebae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.759047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056bc22-60eb-4a82-afc9-4e5897eebae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.763982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056bc22-60eb-4a82-afc9-4e5897eebae9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.792072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 689/1372] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:02.793368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339c8b-aa1d-46f5-b494-716c8172203d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.793665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339c8b-aa1d-46f5-b494-716c8172203d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.793944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339c8b-aa1d-46f5-b494-716c8172203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.796241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:02.819445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:02.850380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-23339c8b-aa1d-46f5-b494-716c8172203d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:02.851259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-23339c8b-aa1d-46f5-b494-716c8172203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:02.939794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925a4f-4ce1-4c8f-85b2-89e16ea34d98 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:02.954950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:02.955649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:02.957082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:02.957367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] PATH_INFO: `/v3/projects/795adf1df20247409670ee6f799df1f4/users/10ce34ccca18444abd3fc012af3c03c9/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:02.964328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795adf1df20247409670ee6f799df1f4, user_id=10ce34ccca18444abd3fc012af3c03c9, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:02.971901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:02.999379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 684/1373] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:02 2022] PUT /identity/v3/projects/795adf1df20247409670ee6f799df1f4/users/10ce34ccca18444abd3fc012af3c03c9/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:03.010110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:03.014031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:03.031736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 690/1374] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:03.031942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23339c8b-aa1d-46f5-b494-716c8172203d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:03.034720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-23339c8b-aa1d-46f5-b494-716c8172203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:03.058774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23339c8b-aa1d-46f5-b494-716c8172203d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:03.130263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059eb36-bac6-42e5-abc6-44c61609eea7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:03.142282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f0688-2383-404b-afd7-d3f091be7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:03.143208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0688-2383-404b-afd7-d3f091be7052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:03.143679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0688-2383-404b-afd7-d3f091be7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:03.144123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0688-2383-404b-afd7-d3f091be7052 admin admin] PATH_INFO: `/v3/projects/997c0cf94381455eb7cd17ae4bd770ca/users/ae5a49a5042640738be760fe691ae2bd/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:03.167328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0688-2383-404b-afd7-d3f091be7052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=997c0cf94381455eb7cd17ae4bd770ca, user_id=ae5a49a5042640738be760fe691ae2bd, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:03.171740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0688-2383-404b-afd7-d3f091be7052 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:03.196921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:03.197642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:03.198443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:03.198842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] PATH_INFO: `/v3/projects/6e99b166222f4846be7498896d902a37` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:03.200128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e99b166222f4846be7498896d902a37)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:03.202922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:03.210859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 685/1375] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:02 2022] PUT /identity/v3/projects/997c0cf94381455eb7cd17ae4bd770ca/users/ae5a49a5042640738be760fe691ae2bd/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:03.215944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a6f8-e6e6-43dd-a36c-8716430fa026 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:03.216274 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a6f8-e6e6-43dd-a36c-8716430fa026 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:03.216619 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a6f8-e6e6-43dd-a36c-8716430fa026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:03.300519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4138a6f8-e6e6-43dd-a36c-8716430fa026 None None] MFA Rules not processed for user `10ce34ccca18444abd3fc012af3c03c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:03.303368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4138a6f8-e6e6-43dd-a36c-8716430fa026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:03.329487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e99b166222f4846be7498896d902a37', 'request_id': 'req-27d53da5-742d-4c85-bcb6-90b046c05ef4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:03.338569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e99b166222f4846be7498896d902a37', 'request_id': 'req-27d53da5-742d-4c85-bcb6-90b046c05ef4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:03.356076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e99b166222f4846be7498896d902a37', 'request_id': 'req-27d53da5-742d-4c85-bcb6-90b046c05ef4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:03.385836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] The token cache is being invalidate because project 6e99b166222f4846be7498896d902a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:03.391294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:03.398398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:03.403198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 691/1376] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:03 2022] DELETE /identity/v3/projects/6e99b166222f4846be7498896d902a37 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:03.405607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:03.409214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:03.531510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 686/1377] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:03.533190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e6ce-b234-4f87-bb0e-c58bf427a0cb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:03.533333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:03.533507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e6ce-b234-4f87-bb0e-c58bf427a0cb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:03.533753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0e6ce-b234-4f87-bb0e-c58bf427a0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:03.601918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53da5-742d-4c85-bcb6-90b046c05ef4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:03.613413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:03.614940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:03.615222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:03.615497 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:03.621240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:03.624901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b2e0e6ce-b234-4f87-bb0e-c58bf427a0cb None None] MFA Rules not processed for user `ae5a49a5042640738be760fe691ae2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:03.626106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b2e0e6ce-b234-4f87-bb0e-c58bf427a0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:03.638049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:03.822623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 687/1378] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:03.824101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a58f2d-868b-4ac5-88e9-4d5ea9958fa7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:03.824397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a58f2d-868b-4ac5-88e9-4d5ea9958fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:03.824675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a58f2d-868b-4ac5-88e9-4d5ea9958fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:03.828509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:03.840830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:03.861472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 692/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:03.862485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:03.870802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:03.882492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a7a58f2d-868b-4ac5-88e9-4d5ea9958fa7 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:03.883788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a7a58f2d-868b-4ac5-88e9-4d5ea9958fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:03.906933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 688/1380] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:03.908432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56688e-94cc-481a-8ecb-0b66ff49839c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:03.908718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56688e-94cc-481a-8ecb-0b66ff49839c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:03.908991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56688e-94cc-481a-8ecb-0b66ff49839c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:03.915740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 689/1381] 10.222.0.27 () {54 vars in 912 bytes} [Mon Oct 10 16:59:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:59:03.917154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56688e-94cc-481a-8ecb-0b66ff49839c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:03.919043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ee56688e-94cc-481a-8ecb-0b66ff49839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:04.027343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27b78-0f78-4225-a1f4-38744e56bd40 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.039409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abc41a-8ad7-4ad3-beab-7408625b535f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.040196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abc41a-8ad7-4ad3-beab-7408625b535f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.040577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abc41a-8ad7-4ad3-beab-7408625b535f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.040947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abc41a-8ad7-4ad3-beab-7408625b535f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.059252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56688e-94cc-481a-8ecb-0b66ff49839c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.063106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abc41a-8ad7-4ad3-beab-7408625b535f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.064779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abc41a-8ad7-4ad3-beab-7408625b535f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.071349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e80bcc-cd6e-4e9a-921b-b7d4a335dd52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.075154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80bcc-cd6e-4e9a-921b-b7d4a335dd52 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.075855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80bcc-cd6e-4e9a-921b-b7d4a335dd52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.084326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80bcc-cd6e-4e9a-921b-b7d4a335dd52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.098606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 693/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:04.099988 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a70d05-eb3e-455f-9500-c271b11a8b5d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.100398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a70d05-eb3e-455f-9500-c271b11a8b5d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.101514 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a70d05-eb3e-455f-9500-c271b11a8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.123480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e80bcc-cd6e-4e9a-921b-b7d4a335dd52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.132194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e80bcc-cd6e-4e9a-921b-b7d4a335dd52 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.147306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a6a70d05-eb3e-455f-9500-c271b11a8b5d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:04.148706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a6a70d05-eb3e-455f-9500-c271b11a8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:04.159553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 690/1383] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:04.166829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5c14-dd85-4b3c-bbe5-0a136ed65efd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.167119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5c14-dd85-4b3c-bbe5-0a136ed65efd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.167412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5c14-dd85-4b3c-bbe5-0a136ed65efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.179425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 694/1384] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:04.180569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a70d05-eb3e-455f-9500-c271b11a8b5d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:04.197260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a70d05-eb3e-455f-9500-c271b11a8b5d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.233869 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.234753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.235046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.235325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.247613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:04.247613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.250066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.321194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-674b5c14-dd85-4b3c-bbe5-0a136ed65efd None None] MFA Rules not processed for user `b3d805106909465abd09c0daf5ecc1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:04.324661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-674b5c14-dd85-4b3c-bbe5-0a136ed65efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:04.338107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 695/1385] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:59:04.343350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:04.345416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 691/1386] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:04.346305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b5c14-dd85-4b3c-bbe5-0a136ed65efd None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:04.373686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b5c14-dd85-4b3c-bbe5-0a136ed65efd None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.380160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cafc1-0e43-4b25-97e8-c86dec88be91 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.388891 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacd3ba-7317-48fc-9204-d4c0764e4404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.390182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacd3ba-7317-48fc-9204-d4c0764e4404 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.390511 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacd3ba-7317-48fc-9204-d4c0764e4404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.390790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacd3ba-7317-48fc-9204-d4c0764e4404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.391444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacd3ba-7317-48fc-9204-d4c0764e4404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.393373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacd3ba-7317-48fc-9204-d4c0764e4404 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.395089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.395749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.396207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.396489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.402581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:04.439233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 692/1387] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:04 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:04.440559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacd3ba-7317-48fc-9204-d4c0764e4404 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:04.556547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacd3ba-7317-48fc-9204-d4c0764e4404 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.564136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1958491-e55b-4323-9446-b698bdee6df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.564640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958491-e55b-4323-9446-b698bdee6df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.564940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958491-e55b-4323-9446-b698bdee6df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.565204 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958491-e55b-4323-9446-b698bdee6df7 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.566034 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958491-e55b-4323-9446-b698bdee6df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.569586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958491-e55b-4323-9446-b698bdee6df7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.572750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.574663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.586643 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:04.602034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 696/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:04.603905 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:04.605543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:04.623035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 693/1389] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:04 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:04.627380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1958491-e55b-4323-9446-b698bdee6df7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:04.654191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff6355-7a2d-4b7b-8e6b-2fcc0b3841bd service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.654796 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1958491-e55b-4323-9446-b698bdee6df7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.664873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:04.678721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71028d-8480-4294-8137-157c405121ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.682930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71028d-8480-4294-8137-157c405121ed admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.683228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71028d-8480-4294-8137-157c405121ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.686047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71028d-8480-4294-8137-157c405121ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.688489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71028d-8480-4294-8137-157c405121ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.693682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71028d-8480-4294-8137-157c405121ed admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.734152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 694/1390] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:04.735329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71028d-8480-4294-8137-157c405121ed admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:04.765509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71028d-8480-4294-8137-157c405121ed admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.794415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d8ec7-fb7b-44a4-b349-521fafcebfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.795071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8ec7-fb7b-44a4-b349-521fafcebfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.795352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8ec7-fb7b-44a4-b349-521fafcebfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.795718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8ec7-fb7b-44a4-b349-521fafcebfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.796357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d8ec7-fb7b-44a4-b349-521fafcebfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.812977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d8ec7-fb7b-44a4-b349-521fafcebfa9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.852119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 695/1391] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:04.853409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d8ec7-fb7b-44a4-b349-521fafcebfa9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:04.863673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c971a9-4036-40fe-9c46-801bba4d4ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.864314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c971a9-4036-40fe-9c46-801bba4d4ddc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.864601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c971a9-4036-40fe-9c46-801bba4d4ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.864879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c971a9-4036-40fe-9c46-801bba4d4ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.876072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d8ec7-fb7b-44a4-b349-521fafcebfa9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:04.889911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cbfdc-d1b1-4a26-b8b0-688c1f4b0867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:04.891028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cbfdc-d1b1-4a26-b8b0-688c1f4b0867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:04.894750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cbfdc-d1b1-4a26-b8b0-688c1f4b0867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:04.895282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cbfdc-d1b1-4a26-b8b0-688c1f4b0867 admin admin] PATH_INFO: `/v3/projects/45d6346199b3448989e02009cac256c6/users/de468fe0b4e44b548ebeca9078c2a45f/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:04.897235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c971a9-4036-40fe-9c46-801bba4d4ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.904004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c971a9-4036-40fe-9c46-801bba4d4ddc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.928313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 697/1392] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:04.958674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cbfdc-d1b1-4a26-b8b0-688c1f4b0867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d6346199b3448989e02009cac256c6, user_id=de468fe0b4e44b548ebeca9078c2a45f, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:04.965199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cbfdc-d1b1-4a26-b8b0-688c1f4b0867 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:04.999610 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 696/1393] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:04 2022] PUT /identity/v3/projects/45d6346199b3448989e02009cac256c6/users/de468fe0b4e44b548ebeca9078c2a45f/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:05.010238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661ac87-c964-4b3b-a70a-d65be4e7be0d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:05.010585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661ac87-c964-4b3b-a70a-d65be4e7be0d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:05.010868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661ac87-c964-4b3b-a70a-d65be4e7be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:05.070700 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3661ac87-c964-4b3b-a70a-d65be4e7be0d None None] MFA Rules not processed for user `de468fe0b4e44b548ebeca9078c2a45f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:05.072509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3661ac87-c964-4b3b-a70a-d65be4e7be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:05.194984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 698/1394] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:05.197341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cbfdc-d1b1-4a26-b8b0-688c1f4b0867 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:05.333593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cbfdc-d1b1-4a26-b8b0-688c1f4b0867 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:05.339456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4a43-f1d2-4cb0-a68a-d65ca248990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:05.340128 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4a43-f1d2-4cb0-a68a-d65ca248990e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:05.341807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4a43-f1d2-4cb0-a68a-d65ca248990e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:05.342174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4a43-f1d2-4cb0-a68a-d65ca248990e admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:05.346323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb4a43-f1d2-4cb0-a68a-d65ca248990e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:05.348945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb4a43-f1d2-4cb0-a68a-d65ca248990e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:05.402354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 697/1395] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:05 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:05.408449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661ac87-c964-4b3b-a70a-d65be4e7be0d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:05.430203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661ac87-c964-4b3b-a70a-d65be4e7be0d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:05.624660 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3632d-7084-432e-8d8d-d32e20ea2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:05.625313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3632d-7084-432e-8d8d-d32e20ea2df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:05.625600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3632d-7084-432e-8d8d-d32e20ea2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:05.625880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3632d-7084-432e-8d8d-d32e20ea2df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:05.626564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3632d-7084-432e-8d8d-d32e20ea2df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:05.634274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3632d-7084-432e-8d8d-d32e20ea2df6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:05.697709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 699/1396] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:05 2022] POST /identity/v3/users => generated 296 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:05.704231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4a43-f1d2-4cb0-a68a-d65ca248990e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:05.720812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4a43-f1d2-4cb0-a68a-d65ca248990e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:05.736396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:05.737093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:05.737422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:05.737701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:05.738361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:05.740135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:05.773606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 698/1397] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:05.778682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3632d-7084-432e-8d8d-d32e20ea2df6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:05.792111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3632d-7084-432e-8d8d-d32e20ea2df6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:05.804307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0016f9-8234-4eb5-84b3-b90cc82f49db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:05.806095 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0016f9-8234-4eb5-84b3-b90cc82f49db admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:05.808017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0016f9-8234-4eb5-84b3-b90cc82f49db admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:05.808229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0016f9-8234-4eb5-84b3-b90cc82f49db admin admin] PATH_INFO: `/v3/projects/9740bdb6f859419993ea32f195aa945c/users/19ae5622cf4c43d3bff8f3f7db7dec89/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:05.851115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0016f9-8234-4eb5-84b3-b90cc82f49db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9740bdb6f859419993ea32f195aa945c, user_id=19ae5622cf4c43d3bff8f3f7db7dec89, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:05.853827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0016f9-8234-4eb5-84b3-b90cc82f49db admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:05.880308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:05.883612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:05.898472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 700/1398] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:05 2022] PUT /identity/v3/projects/9740bdb6f859419993ea32f195aa945c/users/19ae5622cf4c43d3bff8f3f7db7dec89/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:05.902314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0016f9-8234-4eb5-84b3-b90cc82f49db admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:05.911283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:05.920495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c489ca-dd53-46ad-b502-38087c517b77 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:06.074780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0016f9-8234-4eb5-84b3-b90cc82f49db admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:06.082727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:06.083458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:06.083742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:06.084157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] PATH_INFO: `/v3/projects/add625f1f39e4de49ace5092a14ba8a2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:06.086742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] RBAC: Authorizing `identity:delete_project(project_id=add625f1f39e4de49ace5092a14ba8a2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:06.090183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e93dd9-87a8-408f-a160-dc821c177286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:06.091104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:06.094179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93dd9-87a8-408f-a160-dc821c177286 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:06.095074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93dd9-87a8-408f-a160-dc821c177286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:06.096002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93dd9-87a8-408f-a160-dc821c177286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:06.096784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e93dd9-87a8-408f-a160-dc821c177286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:06.100669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e93dd9-87a8-408f-a160-dc821c177286 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:06.137231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 701/1399] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:06.140346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e93dd9-87a8-408f-a160-dc821c177286 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:06.145912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:06.169786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e93dd9-87a8-408f-a160-dc821c177286 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:06.186714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2b7bb-ca9c-4478-bb97-a1ec7c27d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:06.188894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b7bb-ca9c-4478-bb97-a1ec7c27d521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:06.190633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b7bb-ca9c-4478-bb97-a1ec7c27d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:06.190992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b7bb-ca9c-4478-bb97-a1ec7c27d521 admin admin] PATH_INFO: `/v3/projects/9740bdb6f859419993ea32f195aa945c/users/19ae5622cf4c43d3bff8f3f7db7dec89/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:06.196409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2b7bb-ca9c-4478-bb97-a1ec7c27d521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9740bdb6f859419993ea32f195aa945c, user_id=19ae5622cf4c43d3bff8f3f7db7dec89, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:06.205030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2b7bb-ca9c-4478-bb97-a1ec7c27d521 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:06.223047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add625f1f39e4de49ace5092a14ba8a2', 'request_id': 'req-06fdcfa5-5093-429d-82a6-097b61b3549e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:06.242209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add625f1f39e4de49ace5092a14ba8a2', 'request_id': 'req-06fdcfa5-5093-429d-82a6-097b61b3549e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:06.248841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 702/1400] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:06 2022] PUT /identity/v3/projects/9740bdb6f859419993ea32f195aa945c/users/19ae5622cf4c43d3bff8f3f7db7dec89/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:06.260595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107a311-7757-4e72-8d70-8baa3934a990 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:06.260880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107a311-7757-4e72-8d70-8baa3934a990 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:06.261178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107a311-7757-4e72-8d70-8baa3934a990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:06.267563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add625f1f39e4de49ace5092a14ba8a2', 'request_id': 'req-06fdcfa5-5093-429d-82a6-097b61b3549e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:06.296192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] The token cache is being invalidate because project add625f1f39e4de49ace5092a14ba8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:06.296492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:06.298309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:06.300672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 699/1401] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:05 2022] DELETE /identity/v3/projects/add625f1f39e4de49ace5092a14ba8a2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:06.304728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:06.312045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:06.340894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1107a311-7757-4e72-8d70-8baa3934a990 None None] MFA Rules not processed for user `19ae5622cf4c43d3bff8f3f7db7dec89`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:06.346782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1107a311-7757-4e72-8d70-8baa3934a990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:06.581863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdcfa5-5093-429d-82a6-097b61b3549e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:06.586246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 703/1402] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:06.595182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107a311-7757-4e72-8d70-8baa3934a990 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:06.598438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1107a311-7757-4e72-8d70-8baa3934a990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:06.792032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:06.794581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:06.794853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:06.795102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] PATH_INFO: `/v3/users/629904494dc34b78866b771228100b93` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:06.798055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107a311-7757-4e72-8d70-8baa3934a990 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:06.803763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=629904494dc34b78866b771228100b93)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:06.805601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:06.808325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:06.813719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:06.814141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:06.814442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:06.820160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:06.915228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:06.935621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629904494dc34b78866b771228100b93'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:06.962772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:06.977006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629904494dc34b78866b771228100b93'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:06.999168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629904494dc34b78866b771228100b93'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:06.999709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629904494dc34b78866b771228100b93'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:07.001439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:07.009589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:07.022425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-58eaabc7-0ab5-4d98-a3aa-a1285118ed2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629904494dc34b78866b771228100b93'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:07.031590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 700/1403] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:06 2022] DELETE /identity/v3/users/629904494dc34b78866b771228100b93 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:07.034373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f809-e6e8-4d47-a316-751e44f59a76 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:07.036639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f809-e6e8-4d47-a316-751e44f59a76 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:07.036955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f809-e6e8-4d47-a316-751e44f59a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:07.065721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 704/1404] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:07.066695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:07.071918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:07.124685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1256f809-e6e8-4d47-a316-751e44f59a76 None None] MFA Rules not processed for user `0046dc0cc60049ae8ea43797c84aef61`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:07.124685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1256f809-e6e8-4d47-a316-751e44f59a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:07.289391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b127-60d2-4a30-ac47-13263c690a8f service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:07.368247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 701/1405] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:07.371033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db95939-4b41-4167-b9fd-6588df22c0ba None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:07.371523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db95939-4b41-4167-b9fd-6588df22c0ba None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:07.373289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db95939-4b41-4167-b9fd-6588df22c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:07.435672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9db95939-4b41-4167-b9fd-6588df22c0ba None None] MFA Rules not processed for user `4e66774737b5439d8b615cbb271f1faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:07.438083 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9db95939-4b41-4167-b9fd-6588df22c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:07.439961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:07.440632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:07.441079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:07.441355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:07.443682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:07.458731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:07.460725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:07.480811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 705/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:07.483954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:07.488695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:07.582586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 702/1407] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:07.674829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:07.712447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818f98f-5ea4-420c-8e7c-b856169f8185 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:07.732066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dc551-a45e-4c20-9553-8e9f59bf361a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:07.732799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dc551-a45e-4c20-9553-8e9f59bf361a service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:07.733209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dc551-a45e-4c20-9553-8e9f59bf361a service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:07.733598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dc551-a45e-4c20-9553-8e9f59bf361a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:07.755870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dc551-a45e-4c20-9553-8e9f59bf361a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:07.757929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dc551-a45e-4c20-9553-8e9f59bf361a service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:07.785625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 706/1408] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:08.285832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2fd2-3ae9-4d56-85d8-d9a47ccab574 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:08.286671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2fd2-3ae9-4d56-85d8-d9a47ccab574 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:08.287193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2fd2-3ae9-4d56-85d8-d9a47ccab574 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:08.288956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 703/1409] 10.222.0.27 () {54 vars in 912 bytes} [Mon Oct 10 16:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 16:59:08.301716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9a255-9164-4060-861b-9ecdece7ff80 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:08.302192 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9a255-9164-4060-861b-9ecdece7ff80 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:08.302355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9a255-9164-4060-861b-9ecdece7ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:08.405529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9ba9a255-9164-4060-861b-9ecdece7ff80 None None] MFA Rules not processed for user `b3d805106909465abd09c0daf5ecc1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:08.406884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9ba9a255-9164-4060-861b-9ecdece7ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:08.547290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 707/1410] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 16:59:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:08.567408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d2fd2-3ae9-4d56-85d8-d9a47ccab574 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:08.569375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e80d2fd2-3ae9-4d56-85d8-d9a47ccab574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:08.606036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d2fd2-3ae9-4d56-85d8-d9a47ccab574 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:08.614028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:08.614851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:08.615286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:08.615940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:08.631543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:08.636421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:08.668498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 704/1411] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:09.273485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9a255-9164-4060-861b-9ecdece7ff80 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:09.275227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9ba9a255-9164-4060-861b-9ecdece7ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:09.392172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:09.394121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:09.409753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9a255-9164-4060-861b-9ecdece7ff80 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:09.421885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611667b1-ebb8-4e3b-a2ca-c1fed7c5d0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:09.423328 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611667b1-ebb8-4e3b-a2ca-c1fed7c5d0dc service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:09.423711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611667b1-ebb8-4e3b-a2ca-c1fed7c5d0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:09.424086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611667b1-ebb8-4e3b-a2ca-c1fed7c5d0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:09.431827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-611667b1-ebb8-4e3b-a2ca-c1fed7c5d0dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:09.590003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:09.606332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61329ee5-4f01-44c6-8081-82475ead81d0 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:09.617887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:09.619096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:09.619558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:09.620458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] PATH_INFO: `/v3/projects/55a040ccad1949d79c93e29c86f9b5fa` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:09.624098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a040ccad1949d79c93e29c86f9b5fa)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:09.627134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:09.682780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611667b1-ebb8-4e3b-a2ca-c1fed7c5d0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:09.684629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611667b1-ebb8-4e3b-a2ca-c1fed7c5d0dc service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:09.711169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 708/1412] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:09.749434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a040ccad1949d79c93e29c86f9b5fa', 'request_id': 'req-f3c30ef4-880b-43bb-883f-de4e7ba19713'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:09.775492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a040ccad1949d79c93e29c86f9b5fa', 'request_id': 'req-f3c30ef4-880b-43bb-883f-de4e7ba19713'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:09.790776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a040ccad1949d79c93e29c86f9b5fa', 'request_id': 'req-f3c30ef4-880b-43bb-883f-de4e7ba19713'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:09.818302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] The token cache is being invalidate because project 55a040ccad1949d79c93e29c86f9b5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:09.818946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:09.821289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f3c30ef4-880b-43bb-883f-de4e7ba19713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:09.829210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 705/1413] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:09 2022] DELETE /identity/v3/projects/55a040ccad1949d79c93e29c86f9b5fa => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:09.830713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a49c8-9956-4f50-97d8-4e9564a5b63c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:09.831008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a49c8-9956-4f50-97d8-4e9564a5b63c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:09.831288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a49c8-9956-4f50-97d8-4e9564a5b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:09.888237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c83a49c8-9956-4f50-97d8-4e9564a5b63c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:09.889126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c83a49c8-9956-4f50-97d8-4e9564a5b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:10.039045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:10.097852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 709/1414] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:10.104607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ce82-1780-4b9a-88a0-4f8800040a8d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:10.104607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ce82-1780-4b9a-88a0-4f8800040a8d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:10.104607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ce82-1780-4b9a-88a0-4f8800040a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:10.157904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a923ce82-1780-4b9a-88a0-4f8800040a8d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:10.162299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a923ce82-1780-4b9a-88a0-4f8800040a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:10.185516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 706/1415] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:10.190879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a49c8-9956-4f50-97d8-4e9564a5b63c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:10.210441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a49c8-9956-4f50-97d8-4e9564a5b63c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:10.238151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:10.238948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:10.239161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:10.239445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:10.240113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:10.240423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:10.242171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:10.267659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 710/1416] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:10.271254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923ce82-1780-4b9a-88a0-4f8800040a8d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:10.286888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923ce82-1780-4b9a-88a0-4f8800040a8d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:10.293157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137fcc-eebf-4fb6-acc7-0897bc0f9d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:10.293989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137fcc-eebf-4fb6-acc7-0897bc0f9d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:10.294381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137fcc-eebf-4fb6-acc7-0897bc0f9d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:10.294872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137fcc-eebf-4fb6-acc7-0897bc0f9d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:10.295724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137fcc-eebf-4fb6-acc7-0897bc0f9d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:10.298730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137fcc-eebf-4fb6-acc7-0897bc0f9d52 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:10.353370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 707/1417] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:10 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:10.357561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:10.377095 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4356-2a18-464e-9e40-670acb7e87f3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:10.580534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27c52-ba75-4a0c-9e2e-0da35b6083ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:10.581181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27c52-ba75-4a0c-9e2e-0da35b6083ba admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:10.581491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27c52-ba75-4a0c-9e2e-0da35b6083ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:10.583915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27c52-ba75-4a0c-9e2e-0da35b6083ba admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:10.585252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d27c52-ba75-4a0c-9e2e-0da35b6083ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:10.591155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d27c52-ba75-4a0c-9e2e-0da35b6083ba admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:10.668125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 711/1418] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:10 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:10.672089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137fcc-eebf-4fb6-acc7-0897bc0f9d52 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:10.695521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137fcc-eebf-4fb6-acc7-0897bc0f9d52 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:10.719684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a1b89-b32a-433b-86a0-d605ffc98a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:10.722311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a1b89-b32a-433b-86a0-d605ffc98a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:10.726250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a1b89-b32a-433b-86a0-d605ffc98a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:10.726702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a1b89-b32a-433b-86a0-d605ffc98a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:10.729167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a1b89-b32a-433b-86a0-d605ffc98a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:10.737743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a1b89-b32a-433b-86a0-d605ffc98a94 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:10.758907 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 708/1419] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:10.768575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27c52-ba75-4a0c-9e2e-0da35b6083ba admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:10.798383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27c52-ba75-4a0c-9e2e-0da35b6083ba admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:10.814763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ad74-e1a4-4f97-b992-7aade3809be7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:10.815112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ad74-e1a4-4f97-b992-7aade3809be7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:10.815399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ad74-e1a4-4f97-b992-7aade3809be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:10.830018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:10.830953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:10.831633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:10.833266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:10.834874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:10.840775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:10.876842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 712/1420] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:10.878058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:10.884970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:10.899552 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8999ad74-e1a4-4f97-b992-7aade3809be7 None None] MFA Rules not processed for user `011c3876fb3c4e5296f5fa164b7b886b`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:10.901731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8999ad74-e1a4-4f97-b992-7aade3809be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:10.960801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4029f3-a775-4892-b997-6ec6dbac2ef1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:10.975226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:10.975986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:10.976338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:10.976690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] PATH_INFO: `/v3/users/72848f2ce38647cb964bdc7529f70014` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:10.980690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72848f2ce38647cb964bdc7529f70014)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:10.984440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:11.074946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 709/1421] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:11.078256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ad74-e1a4-4f97-b992-7aade3809be7 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:11.102988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ad74-e1a4-4f97-b992-7aade3809be7 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:11.114327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef4fe7-919b-4e3b-b1cf-41c42c3df94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:11.115479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef4fe7-919b-4e3b-b1cf-41c42c3df94c admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:11.116087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef4fe7-919b-4e3b-b1cf-41c42c3df94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:11.116734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef4fe7-919b-4e3b-b1cf-41c42c3df94c admin admin] PATH_INFO: `/v3/projects/e9a7b915aae24fdc9185198e7f12689c/users/8f4869d930e5485ab5764c73e9ac5379/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:11.142983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef4fe7-919b-4e3b-b1cf-41c42c3df94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a7b915aae24fdc9185198e7f12689c, user_id=8f4869d930e5485ab5764c73e9ac5379, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:11.146471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef4fe7-919b-4e3b-b1cf-41c42c3df94c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:11.161632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72848f2ce38647cb964bdc7529f70014'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:11.162639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72848f2ce38647cb964bdc7529f70014'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:11.181625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 710/1422] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:11 2022] PUT /identity/v3/projects/e9a7b915aae24fdc9185198e7f12689c/users/8f4869d930e5485ab5764c73e9ac5379/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:11.197922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e31d-2c96-47cf-b17c-e203646e4317 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:11.198765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e31d-2c96-47cf-b17c-e203646e4317 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:11.198765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e31d-2c96-47cf-b17c-e203646e4317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:11.205073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72848f2ce38647cb964bdc7529f70014'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:11.238800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72848f2ce38647cb964bdc7529f70014'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:11.242244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebcc368b-207e-411e-b189-a6cbdf0ae074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72848f2ce38647cb964bdc7529f70014'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:11.250459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f832e31d-2c96-47cf-b17c-e203646e4317 None None] MFA Rules not processed for user `011c3876fb3c4e5296f5fa164b7b886b`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:11.252273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f832e31d-2c96-47cf-b17c-e203646e4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:11.267595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:11.273459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 713/1423] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:10 2022] DELETE /identity/v3/users/72848f2ce38647cb964bdc7529f70014 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:11.277025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a354-14a1-4e31-a0fd-5cc44ffd2310 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:11.277960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a354-14a1-4e31-a0fd-5cc44ffd2310 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:11.278722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a354-14a1-4e31-a0fd-5cc44ffd2310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:11.352527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1575a354-14a1-4e31-a0fd-5cc44ffd2310 None None] MFA Rules not processed for user `8f4869d930e5485ab5764c73e9ac5379`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:11.353958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1575a354-14a1-4e31-a0fd-5cc44ffd2310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:11.378652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:11.418909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 711/1424] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:11.418909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f105a-ed53-41af-b535-38ea7e786ff2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:11.418909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f105a-ed53-41af-b535-38ea7e786ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:11.418909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f105a-ed53-41af-b535-38ea7e786ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:11.441157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-599f105a-ed53-41af-b535-38ea7e786ff2 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:11.442879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-599f105a-ed53-41af-b535-38ea7e786ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:11.594753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 712/1425] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:11.595890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f105a-ed53-41af-b535-38ea7e786ff2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:11.599039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-599f105a-ed53-41af-b535-38ea7e786ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:11.640609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 714/1426] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:11.642168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721368c4-bb1f-45c8-9acc-d92be5d54dff None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:11.642460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721368c4-bb1f-45c8-9acc-d92be5d54dff None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:11.642762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721368c4-bb1f-45c8-9acc-d92be5d54dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:11.818828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-721368c4-bb1f-45c8-9acc-d92be5d54dff None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:11.824599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-721368c4-bb1f-45c8-9acc-d92be5d54dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:11.851749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f105a-ed53-41af-b535-38ea7e786ff2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:11.872034 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:11.872666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:11.876520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:11.876843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:11.896451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:12.078824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 715/1427] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:12.080787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721368c4-bb1f-45c8-9acc-d92be5d54dff None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:12.088631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-721368c4-bb1f-45c8-9acc-d92be5d54dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:12.113737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:12.124015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:12.129971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:12.147428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721368c4-bb1f-45c8-9acc-d92be5d54dff None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:12.171685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 713/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:12.172254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:12.181646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:12.183910 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9826-0253-46af-a8f0-1b93d13b7f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:12.184549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9826-0253-46af-a8f0-1b93d13b7f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:12.184829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9826-0253-46af-a8f0-1b93d13b7f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:12.185102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9826-0253-46af-a8f0-1b93d13b7f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:12.185749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9826-0253-46af-a8f0-1b93d13b7f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:12.187837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9826-0253-46af-a8f0-1b93d13b7f1b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:12.309695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 716/1429] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:12 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:12.311805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9826-0253-46af-a8f0-1b93d13b7f1b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:12.418409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b449e-cd13-4df4-8e13-3ac903356d70 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:12.618731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9826-0253-46af-a8f0-1b93d13b7f1b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:12.623042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd7ac4-c6de-4413-8f06-08d6207f8e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:12.624401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7ac4-c6de-4413-8f06-08d6207f8e43 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:12.624917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7ac4-c6de-4413-8f06-08d6207f8e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:12.625669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7ac4-c6de-4413-8f06-08d6207f8e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:12.642240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:12.642907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:12.644178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:12.644766 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:12.647573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:12.653736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:12.661404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd7ac4-c6de-4413-8f06-08d6207f8e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:12.675870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd7ac4-c6de-4413-8f06-08d6207f8e43 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:12.700241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:12.714877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 714/1430] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:12.721218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d2c6-1738-4110-aaab-098b72b35c36 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:12.722368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d2c6-1738-4110-aaab-098b72b35c36 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:12.723150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d2c6-1738-4110-aaab-098b72b35c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:12.740676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 717/1431] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:12 2022] POST /identity/v3/users => generated 300 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:12.743223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:12.762619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:12.865006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8c95d2c6-1738-4110-aaab-098b72b35c36 None None] MFA Rules not processed for user `9d51c7335010488d8a2bdc329f975dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:12.869627 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8c95d2c6-1738-4110-aaab-098b72b35c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:13.058265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827db47-3f85-464a-9805-2d658e6b628c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:13.067832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527dee0-dea1-422d-8272-7ee24f3df6eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:13.068695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527dee0-dea1-422d-8272-7ee24f3df6eb service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:13.069200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527dee0-dea1-422d-8272-7ee24f3df6eb service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:13.069713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527dee0-dea1-422d-8272-7ee24f3df6eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:13.176801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 715/1432] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:13.177675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95d2c6-1738-4110-aaab-098b72b35c36 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:13.244128 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95d2c6-1738-4110-aaab-098b72b35c36 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:13.254617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6275b0-7d46-4084-9d9b-30df89133dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:13.255228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6275b0-7d46-4084-9d9b-30df89133dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:13.255509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6275b0-7d46-4084-9d9b-30df89133dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:13.255784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6275b0-7d46-4084-9d9b-30df89133dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:13.256480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6275b0-7d46-4084-9d9b-30df89133dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:13.259177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6275b0-7d46-4084-9d9b-30df89133dc5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:13.323152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 716/1433] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:13.332435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6275b0-7d46-4084-9d9b-30df89133dc5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:13.378350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6275b0-7d46-4084-9d9b-30df89133dc5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:13.403918 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:13.408127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:13.408442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:13.408730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] PATH_INFO: `/v3/projects/809ff737096d40538031f4259a39f9de/users/560db20b91ae411f8a367635d113092d/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:13.461176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=809ff737096d40538031f4259a39f9de, user_id=560db20b91ae411f8a367635d113092d, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:13.472616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:13.528501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 717/1434] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:13 2022] PUT /identity/v3/projects/809ff737096d40538031f4259a39f9de/users/560db20b91ae411f8a367635d113092d/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:13.534954 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:13.541988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:13.595740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:13.721443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527dee0-dea1-422d-8272-7ee24f3df6eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:13.724001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527dee0-dea1-422d-8272-7ee24f3df6eb service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:13.749188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 718/1435] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 16:59:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1008 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 16:59:13.750672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527dee0-dea1-422d-8272-7ee24f3df6eb service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:13.774858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527dee0-dea1-422d-8272-7ee24f3df6eb service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:13.809870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd6a31-7fc8-44f3-8f61-51a513344dbb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:13.823952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f6c8-71e4-44a3-abbb-26ace585bcb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:13.824625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f6c8-71e4-44a3-abbb-26ace585bcb7 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:13.824959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f6c8-71e4-44a3-abbb-26ace585bcb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:13.825228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f6c8-71e4-44a3-abbb-26ace585bcb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:13.975045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cc33b-2a4a-4013-883a-92fe9d7a0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:13.976138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cc33b-2a4a-4013-883a-92fe9d7a0172 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:13.976594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cc33b-2a4a-4013-883a-92fe9d7a0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:13.977414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cc33b-2a4a-4013-883a-92fe9d7a0172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:13.978232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cc33b-2a4a-4013-883a-92fe9d7a0172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:13.982865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cc33b-2a4a-4013-883a-92fe9d7a0172 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:14.009664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5f6c8-71e4-44a3-abbb-26ace585bcb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:14.012399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 719/1436] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:14.015442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5f6c8-71e4-44a3-abbb-26ace585bcb7 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:14.029362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cc33b-2a4a-4013-883a-92fe9d7a0172 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:14.050404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 718/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:14.068830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cc33b-2a4a-4013-883a-92fe9d7a0172 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:14.083670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:14.084515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:14.084951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:14.085262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] PATH_INFO: `/v3/projects/809ff737096d40538031f4259a39f9de/users/560db20b91ae411f8a367635d113092d/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:14.091383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=809ff737096d40538031f4259a39f9de, user_id=560db20b91ae411f8a367635d113092d, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:14.098934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:14.111973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:14.146100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 720/1438] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:14 2022] PUT /identity/v3/projects/809ff737096d40538031f4259a39f9de/users/560db20b91ae411f8a367635d113092d/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:14.147225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f6c8-9bde-4c96-bbf3-9cfe2685f8dc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:14.147508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f6c8-9bde-4c96-bbf3-9cfe2685f8dc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:14.147787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f6c8-9bde-4c96-bbf3-9cfe2685f8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:14.262883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5574f6c8-9bde-4c96-bbf3-9cfe2685f8dc None None] MFA Rules not processed for user `560db20b91ae411f8a367635d113092d`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:14.266449 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5574f6c8-9bde-4c96-bbf3-9cfe2685f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:14.515030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 719/1439] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:14.527734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:14.531282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:14.739986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433364-78b0-442d-bae2-70620cc7ca7d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:14.747264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:14.747975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:14.748252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:14.749118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:14.776362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:14.778161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:14.806390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 721/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:14.902054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f6c8-9bde-4c96-bbf3-9cfe2685f8dc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:14.945097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:14.946767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:15.027956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:15.166198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f6c8-9bde-4c96-bbf3-9cfe2685f8dc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:15.177406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:15.178327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:15.178655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:15.178897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] PATH_INFO: `/v3/users/8f4869d930e5485ab5764c73e9ac5379` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:15.183892 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4869d930e5485ab5764c73e9ac5379)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:15.185935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:15.203664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cbc94-1c77-4f2c-9992-8195c454915d service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:15.227645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:15.228449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:15.228711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:15.228937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] PATH_INFO: `/v3/users/de468fe0b4e44b548ebeca9078c2a45f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:15.231798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de468fe0b4e44b548ebeca9078c2a45f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:15.234687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:15.325494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4869d930e5485ab5764c73e9ac5379'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.364461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4869d930e5485ab5764c73e9ac5379'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.384187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4869d930e5485ab5764c73e9ac5379'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.384187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4869d930e5485ab5764c73e9ac5379'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.393241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f50fda-7df3-4dce-84ef-55104f5dfa2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4869d930e5485ab5764c73e9ac5379'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.395593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de468fe0b4e44b548ebeca9078c2a45f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.396412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de468fe0b4e44b548ebeca9078c2a45f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.405829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de468fe0b4e44b548ebeca9078c2a45f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.422629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 720/1441] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:14 2022] DELETE /identity/v3/users/8f4869d930e5485ab5764c73e9ac5379 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:15.427676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de468fe0b4e44b548ebeca9078c2a45f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.428272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa5032-a347-4441-9f1b-16ae075ba84f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:15.428858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa5032-a347-4441-9f1b-16ae075ba84f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:15.429609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-18aced42-d39b-4c41-ad8e-d8fa78fad33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de468fe0b4e44b548ebeca9078c2a45f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:15.430322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa5032-a347-4441-9f1b-16ae075ba84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:15.466664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 722/1442] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:14 2022] DELETE /identity/v3/users/de468fe0b4e44b548ebeca9078c2a45f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:15.472478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbea39-77f8-446a-a7f5-8108919d05f0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:15.473136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbea39-77f8-446a-a7f5-8108919d05f0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:15.473838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbea39-77f8-446a-a7f5-8108919d05f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:15.524375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-baaa5032-a347-4441-9f1b-16ae075ba84f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:15.531111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-baaa5032-a347-4441-9f1b-16ae075ba84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:15.533744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d7dbea39-77f8-446a-a7f5-8108919d05f0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:15.536986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d7dbea39-77f8-446a-a7f5-8108919d05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:15.599963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:15.790984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 723/1443] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:15.878612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 721/1444] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:16.031222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbea39-77f8-446a-a7f5-8108919d05f0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:16.033578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d7dbea39-77f8-446a-a7f5-8108919d05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:16.175437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa5032-a347-4441-9f1b-16ae075ba84f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:16.177455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-baaa5032-a347-4441-9f1b-16ae075ba84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:16.262738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbea39-77f8-446a-a7f5-8108919d05f0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:16.272101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b94a-ba7a-43d4-bd8e-d3c7911603e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:16.273076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b94a-ba7a-43d4-bd8e-d3c7911603e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:16.273076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b94a-ba7a-43d4-bd8e-d3c7911603e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:16.273267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b94a-ba7a-43d4-bd8e-d3c7911603e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:16.311709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b94a-ba7a-43d4-bd8e-d3c7911603e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:16.313443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b94a-ba7a-43d4-bd8e-d3c7911603e2 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:16.336789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 724/1445] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:16.391937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:16.412033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa5032-a347-4441-9f1b-16ae075ba84f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:16.423272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:16.424011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:16.424246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:16.424429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:16.468297 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:16.469837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:16.512138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 722/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:59:17.196338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5342934-f588-4019-9575-71450a9bb014 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:17.196952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5342934-f588-4019-9575-71450a9bb014 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:17.196952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5342934-f588-4019-9575-71450a9bb014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:17.241957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e5342934-f588-4019-9575-71450a9bb014 None None] MFA Rules not processed for user `b3d805106909465abd09c0daf5ecc1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:17.243802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e5342934-f588-4019-9575-71450a9bb014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:17.268868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 725/1447] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Oct 10 16:59:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:17.270046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:17.271734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:17.307263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0198112-9082-4ec6-b96d-09bcb409e649 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:17.337663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:17.340759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:17.341014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:17.341454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] PATH_INFO: `/v3/projects/b9f7880939c849068128f391a2d8ec5b` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:17.345767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f7880939c849068128f391a2d8ec5b)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:17.349315 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:17.440856 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5342934-f588-4019-9575-71450a9bb014 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:17.452296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5342934-f588-4019-9575-71450a9bb014 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:17.479321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc72a-0e45-4665-90a3-7740c08386fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:17.480360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc72a-0e45-4665-90a3-7740c08386fb service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:17.482009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc72a-0e45-4665-90a3-7740c08386fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:17.483015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc72a-0e45-4665-90a3-7740c08386fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:17.522878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dc72a-0e45-4665-90a3-7740c08386fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:17.527468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dc72a-0e45-4665-90a3-7740c08386fb service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:17.580073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 726/1448] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:17.611557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f7880939c849068128f391a2d8ec5b', 'request_id': 'req-1247f0a9-1644-4351-908a-728fadbb04e1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:17.642768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f7880939c849068128f391a2d8ec5b', 'request_id': 'req-1247f0a9-1644-4351-908a-728fadbb04e1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:17.669112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f7880939c849068128f391a2d8ec5b', 'request_id': 'req-1247f0a9-1644-4351-908a-728fadbb04e1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:17.698382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] The token cache is being invalidate because project b9f7880939c849068128f391a2d8ec5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:17.699550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:17.702874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:17.705952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 723/1449] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:17 2022] DELETE /identity/v3/projects/b9f7880939c849068128f391a2d8ec5b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:17.709872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc72a-0e45-4665-90a3-7740c08386fb service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:17.735491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc72a-0e45-4665-90a3-7740c08386fb service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:17.906827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:17.908908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:17.909197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:17.909969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] PATH_INFO: `/v3/users/10ce34ccca18444abd3fc012af3c03c9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:17.912909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ce34ccca18444abd3fc012af3c03c9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:17.919064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:18.061087 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:18.066909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ce34ccca18444abd3fc012af3c03c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:18.068576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ce34ccca18444abd3fc012af3c03c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:18.086794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ce34ccca18444abd3fc012af3c03c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:18.105111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ce34ccca18444abd3fc012af3c03c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:18.105921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ce34ccca18444abd3fc012af3c03c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:18.143526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 727/1450] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:17 2022] DELETE /identity/v3/users/10ce34ccca18444abd3fc012af3c03c9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:18.853853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:18.856764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:18.907426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f0a9-1644-4351-908a-728fadbb04e1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:19.205279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:19.205945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:19.206225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:19.206502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] PATH_INFO: `/v3/users/ae5a49a5042640738be760fe691ae2bd` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:19.207842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5a49a5042640738be760fe691ae2bd)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:19.209913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:19.233332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:19.236037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:19.278492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8adeeb-8190-4e3b-a1e3-840fa42c9128 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:19.317960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:19.318777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:19.319119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:19.319401 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] PATH_INFO: `/v3/projects/e9a7b915aae24fdc9185198e7f12689c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:19.321234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a7b915aae24fdc9185198e7f12689c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:19.327456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:19.376772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5a49a5042640738be760fe691ae2bd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.394863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5a49a5042640738be760fe691ae2bd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.404382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5a49a5042640738be760fe691ae2bd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.405572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5a49a5042640738be760fe691ae2bd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.410561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:19.421008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9799ff4b-b3f6-4039-98cc-bdecf15fbbc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5a49a5042640738be760fe691ae2bd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.433506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 724/1451] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:18 2022] DELETE /identity/v3/users/ae5a49a5042640738be760fe691ae2bd => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:19.440298 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba88e3-b0e1-4d9c-8301-488b51091845 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:19.440731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba88e3-b0e1-4d9c-8301-488b51091845 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:19.441270 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba88e3-b0e1-4d9c-8301-488b51091845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:19.472780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a7b915aae24fdc9185198e7f12689c', 'request_id': 'req-397c1187-21c9-48e9-838e-e084245edfa0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.476538 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f5ba88e3-b0e1-4d9c-8301-488b51091845 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:19.483394 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f5ba88e3-b0e1-4d9c-8301-488b51091845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:19.490825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a7b915aae24fdc9185198e7f12689c', 'request_id': 'req-397c1187-21c9-48e9-838e-e084245edfa0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.503675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a7b915aae24fdc9185198e7f12689c', 'request_id': 'req-397c1187-21c9-48e9-838e-e084245edfa0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.575402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] The token cache is being invalidate because project e9a7b915aae24fdc9185198e7f12689c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:19.575703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.576438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:19.579362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 728/1452] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:19 2022] DELETE /identity/v3/projects/e9a7b915aae24fdc9185198e7f12689c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:19.584932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:19.595034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:19.709934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 725/1453] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:19.821604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1187-21c9-48e9-838e-e084245edfa0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:19.838145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:19.839822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:19.841226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:19.842897 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] PATH_INFO: `/v3/users/560db20b91ae411f8a367635d113092d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:19.846408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560db20b91ae411f8a367635d113092d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:19.852160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:19.939634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba88e3-b0e1-4d9c-8301-488b51091845 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:19.941314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f5ba88e3-b0e1-4d9c-8301-488b51091845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:20.040938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:20.054810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560db20b91ae411f8a367635d113092d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.065274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560db20b91ae411f8a367635d113092d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.095149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560db20b91ae411f8a367635d113092d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.204285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560db20b91ae411f8a367635d113092d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.207264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560db20b91ae411f8a367635d113092d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.248915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 729/1454] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:19 2022] DELETE /identity/v3/users/560db20b91ae411f8a367635d113092d => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:20.250858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:20.262818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:20.299838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba88e3-b0e1-4d9c-8301-488b51091845 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:20.476560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:20.477178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:20.477460 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:20.477731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:20.478557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b6b7-bbf4-400c-9e88-c88e8893b878 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:20.484288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:20.489940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:20.490626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:20.493311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:20.493311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] PATH_INFO: `/v3/projects/45d6346199b3448989e02009cac256c6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:20.494806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d6346199b3448989e02009cac256c6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:20.496876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:20.524769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:20.526058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:20.578612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 726/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:59:20.621849 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d6346199b3448989e02009cac256c6', 'request_id': 'req-92e87405-81cb-48b4-ac51-58d0de82a2ba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.635916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d6346199b3448989e02009cac256c6', 'request_id': 'req-92e87405-81cb-48b4-ac51-58d0de82a2ba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.656932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d6346199b3448989e02009cac256c6', 'request_id': 'req-92e87405-81cb-48b4-ac51-58d0de82a2ba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.678769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] The token cache is being invalidate because project 45d6346199b3448989e02009cac256c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:20.679058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.682249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-92e87405-81cb-48b4-ac51-58d0de82a2ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:20.686486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 730/1456] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:20 2022] DELETE /identity/v3/projects/45d6346199b3448989e02009cac256c6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:20.690675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:20.709285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373eb91-6ce8-4dd1-8f1b-9adcb950a193 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:20.857316 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:20.884692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:20.885361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:20.887564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:20.889145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] PATH_INFO: `/v3/users/19ae5622cf4c43d3bff8f3f7db7dec89` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:20.892230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ae5622cf4c43d3bff8f3f7db7dec89)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:20.901102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:21.012875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ae5622cf4c43d3bff8f3f7db7dec89'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:21.056632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ae5622cf4c43d3bff8f3f7db7dec89'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:21.073375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ae5622cf4c43d3bff8f3f7db7dec89'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:21.076297 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ae5622cf4c43d3bff8f3f7db7dec89'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:21.090230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ae5622cf4c43d3bff8f3f7db7dec89'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:21.107255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 727/1457] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:20 2022] DELETE /identity/v3/users/19ae5622cf4c43d3bff8f3f7db7dec89 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:21.720247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1c361-2de0-44d1-a118-88a2edcf984e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:21.721244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1c361-2de0-44d1-a118-88a2edcf984e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:21.721745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1c361-2de0-44d1-a118-88a2edcf984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:21.757470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:21.759739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:21.783360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cac1c361-2de0-44d1-a118-88a2edcf984e None None] MFA Rules not processed for user `0046dc0cc60049ae8ea43797c84aef61`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:21.791875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cac1c361-2de0-44d1-a118-88a2edcf984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:21.993039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:21.995924 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121caf35-1232-4946-b72a-387b7e22a96e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:22.016038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:22.018314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:22.019701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:22.021269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] PATH_INFO: `/v3/projects/9740bdb6f859419993ea32f195aa945c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:22.024908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9740bdb6f859419993ea32f195aa945c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:22.038141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:22.041193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 731/1458] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:22.153861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9740bdb6f859419993ea32f195aa945c', 'request_id': 'req-8ace377e-49ff-46df-80e1-8188d2691c05'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:22.171801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9740bdb6f859419993ea32f195aa945c', 'request_id': 'req-8ace377e-49ff-46df-80e1-8188d2691c05'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:22.187874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9740bdb6f859419993ea32f195aa945c', 'request_id': 'req-8ace377e-49ff-46df-80e1-8188d2691c05'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:22.212797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] The token cache is being invalidate because project 9740bdb6f859419993ea32f195aa945c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:22.213467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:22.214393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ace377e-49ff-46df-80e1-8188d2691c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:22.216453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 728/1459] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:21 2022] DELETE /identity/v3/projects/9740bdb6f859419993ea32f195aa945c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:22.221975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff36532-c8c0-4ed6-bc9b-e4b4ec47b845 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:22.222655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff36532-c8c0-4ed6-bc9b-e4b4ec47b845 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:22.223269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff36532-c8c0-4ed6-bc9b-e4b4ec47b845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:22.263020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1ff36532-c8c0-4ed6-bc9b-e4b4ec47b845 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:22.264699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1ff36532-c8c0-4ed6-bc9b-e4b4ec47b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:22.395985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 732/1460] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:22.407462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae94d8-9284-4ca8-8a47-caad5ce18b65 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:22.407769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae94d8-9284-4ca8-8a47-caad5ce18b65 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:22.410394 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae94d8-9284-4ca8-8a47-caad5ce18b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:22.483903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:22.527048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-89ae94d8-9284-4ca8-8a47-caad5ce18b65 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:22.530590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-89ae94d8-9284-4ca8-8a47-caad5ce18b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:22.572850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff36532-c8c0-4ed6-bc9b-e4b4ec47b845 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:22.581369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 729/1461] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:22.587481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff36532-c8c0-4ed6-bc9b-e4b4ec47b845 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:22.602968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:22.606280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:22.610853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:22.611376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:22.612222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:22.613885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:22.617158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:22.668093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 733/1462] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:22.672725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae94d8-9284-4ca8-8a47-caad5ce18b65 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:22.683107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae94d8-9284-4ca8-8a47-caad5ce18b65 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:22.697236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e3874-1139-4104-bdd5-733a03dc6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:22.697764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e3874-1139-4104-bdd5-733a03dc6fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:22.698032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e3874-1139-4104-bdd5-733a03dc6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:22.698301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e3874-1139-4104-bdd5-733a03dc6fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:22.698988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e3874-1139-4104-bdd5-733a03dc6fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:22.701049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e3874-1139-4104-bdd5-733a03dc6fbc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:22.744427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:22.747164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:22.773163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ffb6-6bbc-477b-9be6-c9f408283962 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:22.797713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:22.798427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:22.798811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:22.799131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] PATH_INFO: `/v3/projects/795adf1df20247409670ee6f799df1f4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:22.801343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795adf1df20247409670ee6f799df1f4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:22.809025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:22.809643 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 730/1463] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:22 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:22.811335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e3874-1139-4104-bdd5-733a03dc6fbc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:22.947282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795adf1df20247409670ee6f799df1f4', 'request_id': 'req-e9a465ee-db47-4708-8b4b-675f10b9e5a5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:22.963237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795adf1df20247409670ee6f799df1f4', 'request_id': 'req-e9a465ee-db47-4708-8b4b-675f10b9e5a5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:22.987332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e3874-1139-4104-bdd5-733a03dc6fbc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:22.987559 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795adf1df20247409670ee6f799df1f4', 'request_id': 'req-e9a465ee-db47-4708-8b4b-675f10b9e5a5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:23.022357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] The token cache is being invalidate because project 795adf1df20247409670ee6f799df1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:23.022738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:23.027664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e9a465ee-db47-4708-8b4b-675f10b9e5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:23.035521 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 734/1464] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:22 2022] DELETE /identity/v3/projects/795adf1df20247409670ee6f799df1f4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:23.037524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fef3cb-aaf8-4918-bf49-095fe0ad6f92 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.040590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fef3cb-aaf8-4918-bf49-095fe0ad6f92 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.040991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fef3cb-aaf8-4918-bf49-095fe0ad6f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.087414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b3fef3cb-aaf8-4918-bf49-095fe0ad6f92 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:23.090775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b3fef3cb-aaf8-4918-bf49-095fe0ad6f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:23.134473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387983-c8e9-455b-a8c0-2c3f2a33b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:23.135799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387983-c8e9-455b-a8c0-2c3f2a33b9ac admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.136224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387983-c8e9-455b-a8c0-2c3f2a33b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.136666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387983-c8e9-455b-a8c0-2c3f2a33b9ac admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.137820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387983-c8e9-455b-a8c0-2c3f2a33b9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:23.141726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387983-c8e9-455b-a8c0-2c3f2a33b9ac admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:23.190181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 731/1465] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:22 2022] POST /identity/v3/users => generated 289 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:23.192155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b972-19c4-4294-9e90-faacb904f5eb None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.192616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b972-19c4-4294-9e90-faacb904f5eb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.195616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b972-19c4-4294-9e90-faacb904f5eb None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.199965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 732/1466] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 16:59:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:59:23.205586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b972-19c4-4294-9e90-faacb904f5eb None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:23.212218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5211b972-19c4-4294-9e90-faacb904f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:23.253459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 735/1467] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:23.259469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d98293-77a2-41d7-a79d-e1ee86b29b92 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.259765 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d98293-77a2-41d7-a79d-e1ee86b29b92 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.260262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d98293-77a2-41d7-a79d-e1ee86b29b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.276795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b972-19c4-4294-9e90-faacb904f5eb None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:23.293353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02522-6fb0-4bc1-9eca-f4ca5815dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:23.294388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02522-6fb0-4bc1-9eca-f4ca5815dafc admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.295050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02522-6fb0-4bc1-9eca-f4ca5815dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.295329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02522-6fb0-4bc1-9eca-f4ca5815dafc admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.296714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d02522-6fb0-4bc1-9eca-f4ca5815dafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:23.300766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d02522-6fb0-4bc1-9eca-f4ca5815dafc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:23.334783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-46d98293-77a2-41d7-a79d-e1ee86b29b92 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:23.342056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46d98293-77a2-41d7-a79d-e1ee86b29b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:23.342435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 733/1468] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:23.348266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02522-6fb0-4bc1-9eca-f4ca5815dafc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:23.376339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 736/1469] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:23.377338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d98293-77a2-41d7-a79d-e1ee86b29b92 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:23.379221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02522-6fb0-4bc1-9eca-f4ca5815dafc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:23.384615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac97bc5-42d8-4b5c-88f2-ec8d1a128878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:23.385373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac97bc5-42d8-4b5c-88f2-ec8d1a128878 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.386866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac97bc5-42d8-4b5c-88f2-ec8d1a128878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.388010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac97bc5-42d8-4b5c-88f2-ec8d1a128878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.389754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac97bc5-42d8-4b5c-88f2-ec8d1a128878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:23.391740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac97bc5-42d8-4b5c-88f2-ec8d1a128878 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:23.399196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:23.427983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d98293-77a2-41d7-a79d-e1ee86b29b92 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:23.435946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 734/1470] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:23.441476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac97bc5-42d8-4b5c-88f2-ec8d1a128878 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:23.454057 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4cb3-d27d-4ac0-b6ed-7782c7d544ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:23.456243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4cb3-d27d-4ac0-b6ed-7782c7d544ed admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.457589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4cb3-d27d-4ac0-b6ed-7782c7d544ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.458747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4cb3-d27d-4ac0-b6ed-7782c7d544ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.462513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4cb3-d27d-4ac0-b6ed-7782c7d544ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:23.462847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4cb3-d27d-4ac0-b6ed-7782c7d544ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:23.465116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac97bc5-42d8-4b5c-88f2-ec8d1a128878 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:23.473851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4cb3-d27d-4ac0-b6ed-7782c7d544ed admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:23.491466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:23.501661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.501661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.502289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] PATH_INFO: `/v3/projects/efa5dc25461449ff9f3fa96a19855459/users/a500ff9042db4bc1b3d5b467d45350bc/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.522616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 737/1471] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:23.523034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20890-5ba6-400a-b7d4-ab884bcabc81 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:23.525433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20890-5ba6-400a-b7d4-ab884bcabc81 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:23.525909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20890-5ba6-400a-b7d4-ab884bcabc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:23.555793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa5dc25461449ff9f3fa96a19855459, user_id=a500ff9042db4bc1b3d5b467d45350bc, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:23.563183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:23.606183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-68b20890-5ba6-400a-b7d4-ab884bcabc81 None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:23.608500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-68b20890-5ba6-400a-b7d4-ab884bcabc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:23.612275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 735/1472] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:23 2022] PUT /identity/v3/projects/efa5dc25461449ff9f3fa96a19855459/users/a500ff9042db4bc1b3d5b467d45350bc/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:23.614050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:23.642458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:23.845782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:24.014604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 738/1473] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:24.025124 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b20890-5ba6-400a-b7d4-ab884bcabc81 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:24.027842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461874f3-82f6-48f6-9ef1-a41aefef7340 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:24.050351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:24.051337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b20890-5ba6-400a-b7d4-ab884bcabc81 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:24.053214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:24.053933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:24.054224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] PATH_INFO: `/v3/projects/809ff737096d40538031f4259a39f9de` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:24.057660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809ff737096d40538031f4259a39f9de)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:24.062633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:24.063517 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487398f-7a79-4e0d-9266-0a044ea38f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:24.071350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487398f-7a79-4e0d-9266-0a044ea38f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:24.071650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487398f-7a79-4e0d-9266-0a044ea38f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:24.071940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487398f-7a79-4e0d-9266-0a044ea38f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:24.072578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487398f-7a79-4e0d-9266-0a044ea38f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:24.079424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487398f-7a79-4e0d-9266-0a044ea38f5d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:24.144794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 739/1474] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:24 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:24.146137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c17da-a5c7-4ca0-acf1-2563775f0052 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:24.146495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c17da-a5c7-4ca0-acf1-2563775f0052 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:24.146792 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c17da-a5c7-4ca0-acf1-2563775f0052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:24.209929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-327c17da-a5c7-4ca0-acf1-2563775f0052 None None] MFA Rules not processed for user `a500ff9042db4bc1b3d5b467d45350bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:24.211291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-327c17da-a5c7-4ca0-acf1-2563775f0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:24.220970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809ff737096d40538031f4259a39f9de', 'request_id': 'req-74063a0e-6999-4291-8899-ae8ff33c44d0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.252173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809ff737096d40538031f4259a39f9de', 'request_id': 'req-74063a0e-6999-4291-8899-ae8ff33c44d0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.281960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809ff737096d40538031f4259a39f9de', 'request_id': 'req-74063a0e-6999-4291-8899-ae8ff33c44d0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.324427 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] The token cache is being invalidate because project 809ff737096d40538031f4259a39f9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:24.328797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.331645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.340479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 736/1475] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:23 2022] DELETE /identity/v3/projects/809ff737096d40538031f4259a39f9de => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:24.345075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:24.352371 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:24.413243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 740/1476] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:24.414209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c17da-a5c7-4ca0-acf1-2563775f0052 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:24.427350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-327c17da-a5c7-4ca0-acf1-2563775f0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:24.574008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74063a0e-6999-4291-8899-ae8ff33c44d0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:24.586957 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:24.589257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:24.590414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:24.591154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] PATH_INFO: `/v3/projects/997c0cf94381455eb7cd17ae4bd770ca` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:24.594700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=997c0cf94381455eb7cd17ae4bd770ca)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:24.599609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:24.619716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:24.670431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c17da-a5c7-4ca0-acf1-2563775f0052 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:24.682923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fdd92-c579-4ff4-9d20-63c00a926e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:24.683574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fdd92-c579-4ff4-9d20-63c00a926e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:24.683861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fdd92-c579-4ff4-9d20-63c00a926e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:24.684141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fdd92-c579-4ff4-9d20-63c00a926e5e admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:24.684793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fdd92-c579-4ff4-9d20-63c00a926e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:24.695659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fdd92-c579-4ff4-9d20-63c00a926e5e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:24.754442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 741/1477] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:24 2022] POST /identity/v3/users => generated 291 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:24.757543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac805-2e67-42c3-a70f-a73a8e03f613 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:24.758881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac805-2e67-42c3-a70f-a73a8e03f613 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:24.759545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac805-2e67-42c3-a70f-a73a8e03f613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:24.770311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997c0cf94381455eb7cd17ae4bd770ca', 'request_id': 'req-472c69aa-f910-474e-8b3c-14e542659e0c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.788438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997c0cf94381455eb7cd17ae4bd770ca', 'request_id': 'req-472c69aa-f910-474e-8b3c-14e542659e0c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.793319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:24.810598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997c0cf94381455eb7cd17ae4bd770ca', 'request_id': 'req-472c69aa-f910-474e-8b3c-14e542659e0c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.822196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-859ac805-2e67-42c3-a70f-a73a8e03f613 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:24.825731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-859ac805-2e67-42c3-a70f-a73a8e03f613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:24.842760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] The token cache is being invalidate because project 997c0cf94381455eb7cd17ae4bd770ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:24.843419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.845504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:24.849716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 737/1478] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:24 2022] DELETE /identity/v3/projects/997c0cf94381455eb7cd17ae4bd770ca => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:24.851113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:24.852955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:24.993831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 742/1479] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:24.993831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536039-2560-4bba-b484-7f08a9a2a27f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:24.993831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536039-2560-4bba-b484-7f08a9a2a27f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.003086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536039-2560-4bba-b484-7f08a9a2a27f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.007402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 743/1480] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 16:59:24 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:59:25.008487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d536039-2560-4bba-b484-7f08a9a2a27f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:25.012306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c69aa-f910-474e-8b3c-14e542659e0c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:25.017366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0d536039-2560-4bba-b484-7f08a9a2a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:25.029680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538ca37-9d83-46bf-9007-8cea2b723cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:25.030410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ca37-9d83-46bf-9007-8cea2b723cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.030665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ca37-9d83-46bf-9007-8cea2b723cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.030942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ca37-9d83-46bf-9007-8cea2b723cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.031617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538ca37-9d83-46bf-9007-8cea2b723cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:25.033817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538ca37-9d83-46bf-9007-8cea2b723cbb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:25.061485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d536039-2560-4bba-b484-7f08a9a2a27f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:25.095280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eaaab-1c8e-4d7e-b5f8-00525909dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:25.097237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eaaab-1c8e-4d7e-b5f8-00525909dea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.099647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 738/1481] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:24 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:25.099887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eaaab-1c8e-4d7e-b5f8-00525909dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.100566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eaaab-1c8e-4d7e-b5f8-00525909dea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.101145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc53-4009-4920-bf1a-8bbe3d478e53 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.101432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc53-4009-4920-bf1a-8bbe3d478e53 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.101707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc53-4009-4920-bf1a-8bbe3d478e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.104011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eaaab-1c8e-4d7e-b5f8-00525909dea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:25.109954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eaaab-1c8e-4d7e-b5f8-00525909dea4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:25.136381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 744/1482] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:25.142532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b27c3-6bb7-47ab-834d-080bbb18914f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.144490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b27c3-6bb7-47ab-834d-080bbb18914f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.146156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b27c3-6bb7-47ab-834d-080bbb18914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.162279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6249bc53-4009-4920-bf1a-8bbe3d478e53 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:25.163965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6249bc53-4009-4920-bf1a-8bbe3d478e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:25.210960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-de8b27c3-6bb7-47ab-834d-080bbb18914f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:25.214128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-de8b27c3-6bb7-47ab-834d-080bbb18914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:25.339501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 739/1483] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:25.339501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bc53-4009-4920-bf1a-8bbe3d478e53 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:25.339501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6249bc53-4009-4920-bf1a-8bbe3d478e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:25.434032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 745/1484] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:25.434935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b27c3-6bb7-47ab-834d-080bbb18914f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:25.464274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b27c3-6bb7-47ab-834d-080bbb18914f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:25.472670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8565f-0a36-4fb5-bafb-2549cff8277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:25.473295 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8565f-0a36-4fb5-bafb-2549cff8277c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.473585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8565f-0a36-4fb5-bafb-2549cff8277c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.473908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8565f-0a36-4fb5-bafb-2549cff8277c admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.474788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8565f-0a36-4fb5-bafb-2549cff8277c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:25.479539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8565f-0a36-4fb5-bafb-2549cff8277c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:25.518710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 746/1485] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:25 2022] POST /identity/v3/users => generated 296 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:25.520532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8565f-0a36-4fb5-bafb-2549cff8277c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:25.536621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8565f-0a36-4fb5-bafb-2549cff8277c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:25.544057 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccf9d8-5077-41c9-951b-e8f46f0bfec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:25.544810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccf9d8-5077-41c9-951b-e8f46f0bfec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.545107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccf9d8-5077-41c9-951b-e8f46f0bfec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.546446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccf9d8-5077-41c9-951b-e8f46f0bfec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.547589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccf9d8-5077-41c9-951b-e8f46f0bfec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:25.549615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccf9d8-5077-41c9-951b-e8f46f0bfec7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:25.578018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 747/1486] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:25.579581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f64c72-a787-47b9-9564-c12c57a2d613 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.583891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f64c72-a787-47b9-9564-c12c57a2d613 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.584178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f64c72-a787-47b9-9564-c12c57a2d613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.586734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bc53-4009-4920-bf1a-8bbe3d478e53 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:25.612210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8acd92-e5a0-4eda-9f21-736486e1f6d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:25.612858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8acd92-e5a0-4eda-9f21-736486e1f6d5 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.613484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8acd92-e5a0-4eda-9f21-736486e1f6d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.613484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8acd92-e5a0-4eda-9f21-736486e1f6d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.619028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-aa8acd92-e5a0-4eda-9f21-736486e1f6d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:25.632222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-82f64c72-a787-47b9-9564-c12c57a2d613 None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:25.633552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-82f64c72-a787-47b9-9564-c12c57a2d613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:25.660656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:25.661723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 748/1487] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 16:59:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:25.663258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e45f46-1672-49e7-8540-ebd5cd2a032f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.665581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e45f46-1672-49e7-8540-ebd5cd2a032f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.665695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8acd92-e5a0-4eda-9f21-736486e1f6d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:25.665921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e45f46-1672-49e7-8540-ebd5cd2a032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.672554 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8acd92-e5a0-4eda-9f21-736486e1f6d5 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:25.709110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-13e45f46-1672-49e7-8540-ebd5cd2a032f None None] MFA Rules not processed for user `9d51c7335010488d8a2bdc329f975dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:25.712319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 740/1488] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:25.712743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-13e45f46-1672-49e7-8540-ebd5cd2a032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:25.714185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641084a0-8e88-4932-9c00-a396526be5a1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.714540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641084a0-8e88-4932-9c00-a396526be5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.714940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641084a0-8e88-4932-9c00-a396526be5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.781583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-641084a0-8e88-4932-9c00-a396526be5a1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:25.790450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-641084a0-8e88-4932-9c00-a396526be5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:25.791632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:25.820365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 741/1489] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:25.824746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641084a0-8e88-4932-9c00-a396526be5a1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:25.864812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641084a0-8e88-4932-9c00-a396526be5a1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:25.884439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:25.885069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.885359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.886370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.886370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:25.886705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:25.888258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:25.896571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 749/1490] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:25.903209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e45f46-1672-49e7-8540-ebd5cd2a032f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:25.933531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e45f46-1672-49e7-8540-ebd5cd2a032f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:25.942745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 742/1491] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:25.943694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:25.972354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563a932-a0cf-4c37-b471-d080b188bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:25.973743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563a932-a0cf-4c37-b471-d080b188bf71 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:25.974068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563a932-a0cf-4c37-b471-d080b188bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:25.974348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563a932-a0cf-4c37-b471-d080b188bf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:25.975213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563a932-a0cf-4c37-b471-d080b188bf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:25.976847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563a932-a0cf-4c37-b471-d080b188bf71 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:25.984507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d514baf-7a9c-48bc-b944-dc9ea078ee02 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:26.005144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7643ec7-85e0-42f1-b575-d9fc7aa1e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:26.005986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643ec7-85e0-42f1-b575-d9fc7aa1e1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:26.006303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643ec7-85e0-42f1-b575-d9fc7aa1e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:26.006620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643ec7-85e0-42f1-b575-d9fc7aa1e1e8 admin admin] PATH_INFO: `/v3/projects/d6d249c59fc14df0b3a8464dff9cdca8/users/eeb455955a984c85a3fae372f811a560/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:26.013211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 750/1492] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:26.018393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563a932-a0cf-4c37-b471-d080b188bf71 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:26.034249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563a932-a0cf-4c37-b471-d080b188bf71 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:26.054390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:26.055498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:26.055998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:26.056484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:26.057407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:26.057922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:26.058034 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7643ec7-85e0-42f1-b575-d9fc7aa1e1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d249c59fc14df0b3a8464dff9cdca8, user_id=eeb455955a984c85a3fae372f811a560, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:26.060275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:26.066404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7643ec7-85e0-42f1-b575-d9fc7aa1e1e8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:26.083507 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 751/1493] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:26.084685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:26.105118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 743/1494] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:25 2022] PUT /identity/v3/projects/d6d249c59fc14df0b3a8464dff9cdca8/users/eeb455955a984c85a3fae372f811a560/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:26.106970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7643ec7-85e0-42f1-b575-d9fc7aa1e1e8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:26.112177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e682d-b04a-4785-9344-1fb1a0f73f98 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:26.234395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7643ec7-85e0-42f1-b575-d9fc7aa1e1e8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:26.258290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c489c35-02ba-4874-9437-e7b6a135b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:26.259042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489c35-02ba-4874-9437-e7b6a135b049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:26.259327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489c35-02ba-4874-9437-e7b6a135b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:26.259605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489c35-02ba-4874-9437-e7b6a135b049 admin admin] PATH_INFO: `/v3/projects/2548b8f01da14fed83959746cf1c8e3d/users/5d0ae83a4ad4424b866897f9411391ed/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:26.263922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73859d33-403f-4c39-8f1d-5e3f1bf5baf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:26.265005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859d33-403f-4c39-8f1d-5e3f1bf5baf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:26.266987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859d33-403f-4c39-8f1d-5e3f1bf5baf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:26.267300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73859d33-403f-4c39-8f1d-5e3f1bf5baf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:26.269325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73859d33-403f-4c39-8f1d-5e3f1bf5baf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:26.274476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73859d33-403f-4c39-8f1d-5e3f1bf5baf2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:26.310351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c489c35-02ba-4874-9437-e7b6a135b049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2548b8f01da14fed83959746cf1c8e3d, user_id=5d0ae83a4ad4424b866897f9411391ed, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:26.321141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c489c35-02ba-4874-9437-e7b6a135b049 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:26.331776 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 752/1495] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:26 2022] POST /identity/v3/projects => generated 401 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:26.349044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73859d33-403f-4c39-8f1d-5e3f1bf5baf2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:26.371205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 744/1496] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:26 2022] PUT /identity/v3/projects/2548b8f01da14fed83959746cf1c8e3d/users/5d0ae83a4ad4424b866897f9411391ed/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:26.371205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139a839-c3e9-4b37-95e7-fd87b915ab69 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:26.371964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139a839-c3e9-4b37-95e7-fd87b915ab69 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:26.371964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139a839-c3e9-4b37-95e7-fd87b915ab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:26.507331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1139a839-c3e9-4b37-95e7-fd87b915ab69 None None] MFA Rules not processed for user `eeb455955a984c85a3fae372f811a560`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:26.513973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1139a839-c3e9-4b37-95e7-fd87b915ab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:26.568840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73859d33-403f-4c39-8f1d-5e3f1bf5baf2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:26.740123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 745/1497] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:26.740123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139a839-c3e9-4b37-95e7-fd87b915ab69 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:26.803826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:26.820242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:26.827215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca24c1-5700-4f73-92f1-b18e5bc84448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:26.829756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca24c1-5700-4f73-92f1-b18e5bc84448 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:26.830291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca24c1-5700-4f73-92f1-b18e5bc84448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:26.830678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca24c1-5700-4f73-92f1-b18e5bc84448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:26.831833 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca24c1-5700-4f73-92f1-b18e5bc84448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:26.837359 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca24c1-5700-4f73-92f1-b18e5bc84448 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:26.897137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 753/1498] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:26 2022] POST /identity/v3/projects => generated 357 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:26.898593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca24c1-5700-4f73-92f1-b18e5bc84448 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:26.929608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139a839-c3e9-4b37-95e7-fd87b915ab69 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.008682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca24c1-5700-4f73-92f1-b18e5bc84448 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.014754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c384-d8b2-47ea-a974-4be885e88834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.015371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c384-d8b2-47ea-a974-4be885e88834 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.015647 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c384-d8b2-47ea-a974-4be885e88834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.015971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c384-d8b2-47ea-a974-4be885e88834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.016714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c384-d8b2-47ea-a974-4be885e88834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.018204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c384-d8b2-47ea-a974-4be885e88834 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.032825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 754/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:27.033593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c384-d8b2-47ea-a974-4be885e88834 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.044549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c384-d8b2-47ea-a974-4be885e88834 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.050457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.051119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.051387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.051661 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.052929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.055280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.057420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2bb74-c5fe-46b9-ae0d-8dd3bf1ce8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.058223 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2bb74-c5fe-46b9-ae0d-8dd3bf1ce8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.058693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2bb74-c5fe-46b9-ae0d-8dd3bf1ce8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.059236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2bb74-c5fe-46b9-ae0d-8dd3bf1ce8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.060130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2bb74-c5fe-46b9-ae0d-8dd3bf1ce8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.063338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2bb74-c5fe-46b9-ae0d-8dd3bf1ce8e9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.090181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 755/1500] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:27 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:27.093162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.094208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 746/1501] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:26 2022] POST /identity/v3/users => generated 301 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:27.095290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2bb74-c5fe-46b9-ae0d-8dd3bf1ce8e9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.099872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:27.110189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2bb74-c5fe-46b9-ae0d-8dd3bf1ce8e9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.191993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7f724-6922-469c-9f15-d95f5b052366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.192518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f724-6922-469c-9f15-d95f5b052366 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.192795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f724-6922-469c-9f15-d95f5b052366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.193066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f724-6922-469c-9f15-d95f5b052366 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.193759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7f724-6922-469c-9f15-d95f5b052366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.195899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7f724-6922-469c-9f15-d95f5b052366 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.205950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931c104-0ecd-4ef9-9a86-72be8c015a13 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.212760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ee2f3-e7df-4a43-bb63-00fc558e1670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.213416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ee2f3-e7df-4a43-bb63-00fc558e1670 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.213724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ee2f3-e7df-4a43-bb63-00fc558e1670 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.214009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ee2f3-e7df-4a43-bb63-00fc558e1670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.225736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ee2f3-e7df-4a43-bb63-00fc558e1670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.227683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ee2f3-e7df-4a43-bb63-00fc558e1670 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.227906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 747/1502] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:27 2022] POST /identity/v3/users => generated 279 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:27.228866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7f724-6922-469c-9f15-d95f5b052366 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.240900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7f724-6922-469c-9f15-d95f5b052366 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.244705 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 756/1503] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:27.245710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ee2f3-e7df-4a43-bb63-00fc558e1670 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.257356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ee2f3-e7df-4a43-bb63-00fc558e1670 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.262804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834476de-fb6d-45ae-a43f-96237b2e0f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.265199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834476de-fb6d-45ae-a43f-96237b2e0f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.265506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834476de-fb6d-45ae-a43f-96237b2e0f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.265792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834476de-fb6d-45ae-a43f-96237b2e0f28 admin admin] PATH_INFO: `/v3/projects/2548b8f01da14fed83959746cf1c8e3d/users/5d0ae83a4ad4424b866897f9411391ed/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.268122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c914a5-4c09-4cd5-8fd8-7f521c1cfe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.269016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c914a5-4c09-4cd5-8fd8-7f521c1cfe6c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.269505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c914a5-4c09-4cd5-8fd8-7f521c1cfe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.269940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c914a5-4c09-4cd5-8fd8-7f521c1cfe6c admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.270761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c914a5-4c09-4cd5-8fd8-7f521c1cfe6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.271975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834476de-fb6d-45ae-a43f-96237b2e0f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2548b8f01da14fed83959746cf1c8e3d, user_id=5d0ae83a4ad4424b866897f9411391ed, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.273446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c914a5-4c09-4cd5-8fd8-7f521c1cfe6c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.278097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834476de-fb6d-45ae-a43f-96237b2e0f28 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.312093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 757/1504] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:27 2022] POST /identity/v3/users => generated 298 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:27.313010 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c914a5-4c09-4cd5-8fd8-7f521c1cfe6c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.316887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 748/1505] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:27 2022] PUT /identity/v3/projects/2548b8f01da14fed83959746cf1c8e3d/users/5d0ae83a4ad4424b866897f9411391ed/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:27.318409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834476de-fb6d-45ae-a43f-96237b2e0f28 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.335428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c914a5-4c09-4cd5-8fd8-7f521c1cfe6c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.348875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:27.410333 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:27.428487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca11d7-18ae-49f0-9b39-1738a3bbed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.429212 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca11d7-18ae-49f0-9b39-1738a3bbed13 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.429720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca11d7-18ae-49f0-9b39-1738a3bbed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.430074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca11d7-18ae-49f0-9b39-1738a3bbed13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.433213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca11d7-18ae-49f0-9b39-1738a3bbed13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.435230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca11d7-18ae-49f0-9b39-1738a3bbed13 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.453117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 758/1506] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:27.454865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca11d7-18ae-49f0-9b39-1738a3bbed13 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.457198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834476de-fb6d-45ae-a43f-96237b2e0f28 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.463501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984f4a-c0bd-4e8f-90a8-51dcf60f7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.464327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984f4a-c0bd-4e8f-90a8-51dcf60f7f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.464598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984f4a-c0bd-4e8f-90a8-51dcf60f7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.464966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984f4a-c0bd-4e8f-90a8-51dcf60f7f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.465725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984f4a-c0bd-4e8f-90a8-51dcf60f7f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.468230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca11d7-18ae-49f0-9b39-1738a3bbed13 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.468377 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984f4a-c0bd-4e8f-90a8-51dcf60f7f8b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.475499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bfd87-2842-4258-931a-44b379484b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.476475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bfd87-2842-4258-931a-44b379484b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.476943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bfd87-2842-4258-931a-44b379484b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.477370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bfd87-2842-4258-931a-44b379484b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.478911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bfd87-2842-4258-931a-44b379484b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.480960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bfd87-2842-4258-931a-44b379484b6c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.485118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 749/1507] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:27.486465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70b76-905c-4f1c-bfa1-acc5074d7885 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.486785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70b76-905c-4f1c-bfa1-acc5074d7885 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.487062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb70b76-905c-4f1c-bfa1-acc5074d7885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.498984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 759/1508] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:27.500689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bfd87-2842-4258-931a-44b379484b6c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.517475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bfd87-2842-4258-931a-44b379484b6c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.523934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f9bdf-cc01-4ae3-a16c-ad39fc4c86bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.524810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f9bdf-cc01-4ae3-a16c-ad39fc4c86bf admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.525228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f9bdf-cc01-4ae3-a16c-ad39fc4c86bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.525769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f9bdf-cc01-4ae3-a16c-ad39fc4c86bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.526590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f9bdf-cc01-4ae3-a16c-ad39fc4c86bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.529848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f9bdf-cc01-4ae3-a16c-ad39fc4c86bf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.531141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-feb70b76-905c-4f1c-bfa1-acc5074d7885 None None] MFA Rules not processed for user `5d0ae83a4ad4424b866897f9411391ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:27.532554 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-feb70b76-905c-4f1c-bfa1-acc5074d7885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:27.551588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 760/1509] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:27.552876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f9bdf-cc01-4ae3-a16c-ad39fc4c86bf admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.567286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f9bdf-cc01-4ae3-a16c-ad39fc4c86bf admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.579449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e155b4e-4a29-40c1-9b39-c6d2d15be1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.580097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e155b4e-4a29-40c1-9b39-c6d2d15be1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.581112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e155b4e-4a29-40c1-9b39-c6d2d15be1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.581597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e155b4e-4a29-40c1-9b39-c6d2d15be1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.582289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e155b4e-4a29-40c1-9b39-c6d2d15be1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.586723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e155b4e-4a29-40c1-9b39-c6d2d15be1ce admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.603644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 761/1510] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:27.605344 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e155b4e-4a29-40c1-9b39-c6d2d15be1ce admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.618178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e155b4e-4a29-40c1-9b39-c6d2d15be1ce admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.625276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c24dd-237e-492e-a7b5-f20d5e1fe8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.625954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c24dd-237e-492e-a7b5-f20d5e1fe8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.626236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c24dd-237e-492e-a7b5-f20d5e1fe8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.626535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c24dd-237e-492e-a7b5-f20d5e1fe8d2 admin admin] PATH_INFO: `/v3/projects/105c755a8e614536a42151ea0e36713c/users/5bcd4417e8c34f06b69241aab508a92c/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.644865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c24dd-237e-492e-a7b5-f20d5e1fe8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105c755a8e614536a42151ea0e36713c, user_id=5bcd4417e8c34f06b69241aab508a92c, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.648207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c24dd-237e-492e-a7b5-f20d5e1fe8d2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.650301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 750/1511] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:27.651954 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb70b76-905c-4f1c-bfa1-acc5074d7885 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.668583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 762/1512] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:27 2022] PUT /identity/v3/projects/105c755a8e614536a42151ea0e36713c/users/5bcd4417e8c34f06b69241aab508a92c/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:27.669052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb70b76-905c-4f1c-bfa1-acc5074d7885 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.670116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c24dd-237e-492e-a7b5-f20d5e1fe8d2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.736529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.737288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.737629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.737999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] PATH_INFO: `/v3/projects/da4369afc3134a988b5f2c864153776e/users/85e7496635014c2da09a0dd39222ad54/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.741186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c24dd-237e-492e-a7b5-f20d5e1fe8d2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.747309 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d729-c221-4692-8d9f-54e452df012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.748604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d729-c221-4692-8d9f-54e452df012a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.748889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d729-c221-4692-8d9f-54e452df012a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.749272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d729-c221-4692-8d9f-54e452df012a admin admin] PATH_INFO: `/v3/projects/cee1bb1cd57d4a359b443472cc0869a4/users/bf254b4eefa34b9ea9e08a37595fc91d/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.756908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4369afc3134a988b5f2c864153776e, user_id=85e7496635014c2da09a0dd39222ad54, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.759776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.768625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5d729-c221-4692-8d9f-54e452df012a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee1bb1cd57d4a359b443472cc0869a4, user_id=bf254b4eefa34b9ea9e08a37595fc91d, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.772369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5d729-c221-4692-8d9f-54e452df012a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.786340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 751/1513] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:27 2022] PUT /identity/v3/projects/da4369afc3134a988b5f2c864153776e/users/85e7496635014c2da09a0dd39222ad54/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:27.786340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.788450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:27.798892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 763/1514] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:27 2022] PUT /identity/v3/projects/cee1bb1cd57d4a359b443472cc0869a4/users/bf254b4eefa34b9ea9e08a37595fc91d/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:27.799968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d729-c221-4692-8d9f-54e452df012a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:27.851276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:27.866161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:27.869828 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e51e5-351f-4ee1-b721-6f2968f9ae78 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.887083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d729-c221-4692-8d9f-54e452df012a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:27.894630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a8a46-c7bb-41b7-92d6-e50f751d904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.894630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8a46-c7bb-41b7-92d6-e50f751d904a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.894630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8a46-c7bb-41b7-92d6-e50f751d904a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.894630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8a46-c7bb-41b7-92d6-e50f751d904a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.897995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a8a46-c7bb-41b7-92d6-e50f751d904a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:27.899887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a8a46-c7bb-41b7-92d6-e50f751d904a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:27.914551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 764/1515] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:27.920648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4ecb4-1829-4046-9bf8-e2aa537b38b6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.920949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4ecb4-1829-4046-9bf8-e2aa537b38b6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.921353 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4ecb4-1829-4046-9bf8-e2aa537b38b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.952612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94832d1-11dd-4495-85f5-564b69057222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:27.953233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94832d1-11dd-4495-85f5-564b69057222 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:27.953543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94832d1-11dd-4495-85f5-564b69057222 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:27.953820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94832d1-11dd-4495-85f5-564b69057222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:27.956532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-84c4ecb4-1829-4046-9bf8-e2aa537b38b6 None None] MFA Rules not processed for user `85e7496635014c2da09a0dd39222ad54`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:27.958317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-84c4ecb4-1829-4046-9bf8-e2aa537b38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:28.020980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94832d1-11dd-4495-85f5-564b69057222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.023696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94832d1-11dd-4495-85f5-564b69057222 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.034386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 752/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:28.035474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699e9d-b920-446f-8029-783920064849 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.035758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699e9d-b920-446f-8029-783920064849 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.036152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699e9d-b920-446f-8029-783920064849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.038058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 765/1517] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:28.038764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4ecb4-1829-4046-9bf8-e2aa537b38b6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.054175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4ecb4-1829-4046-9bf8-e2aa537b38b6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.067769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef925b41-276b-4920-8061-56e7e923ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.068563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925b41-276b-4920-8061-56e7e923ba3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.068920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925b41-276b-4920-8061-56e7e923ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.069268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925b41-276b-4920-8061-56e7e923ba3d admin admin] PATH_INFO: `/v3/projects/105c755a8e614536a42151ea0e36713c/users/5bcd4417e8c34f06b69241aab508a92c/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.072129 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef925b41-276b-4920-8061-56e7e923ba3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=105c755a8e614536a42151ea0e36713c, user_id=5bcd4417e8c34f06b69241aab508a92c, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.076850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef925b41-276b-4920-8061-56e7e923ba3d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.082995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5d699e9d-b920-446f-8029-783920064849 None None] MFA Rules not processed for user `bf254b4eefa34b9ea9e08a37595fc91d`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:28.084791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5d699e9d-b920-446f-8029-783920064849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:28.097151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 766/1518] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:28 2022] PUT /identity/v3/projects/105c755a8e614536a42151ea0e36713c/users/5bcd4417e8c34f06b69241aab508a92c/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:28.097151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef925b41-276b-4920-8061-56e7e923ba3d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.224601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef925b41-276b-4920-8061-56e7e923ba3d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.233681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b28848-b6a0-4cb3-a29b-77ec336bd4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.234369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28848-b6a0-4cb3-a29b-77ec336bd4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.234969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28848-b6a0-4cb3-a29b-77ec336bd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.235310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28848-b6a0-4cb3-a29b-77ec336bd4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.235848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 753/1519] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:28.236329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b28848-b6a0-4cb3-a29b-77ec336bd4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.239072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096289-d562-406a-8d94-09f912d46554 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.239849 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b28848-b6a0-4cb3-a29b-77ec336bd4fd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.240216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096289-d562-406a-8d94-09f912d46554 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.240564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4096289-d562-406a-8d94-09f912d46554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.310317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 767/1520] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:28 2022] POST /identity/v3/projects => generated 397 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:28.311014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b28848-b6a0-4cb3-a29b-77ec336bd4fd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.314215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f4096289-d562-406a-8d94-09f912d46554 None None] MFA Rules not processed for user `5bcd4417e8c34f06b69241aab508a92c`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:28.315530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f4096289-d562-406a-8d94-09f912d46554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:28.373746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:28.420098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:28.485522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b28848-b6a0-4cb3-a29b-77ec336bd4fd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.493608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe888c4-1e83-4ed7-ad3b-f63338d81608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.494193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe888c4-1e83-4ed7-ad3b-f63338d81608 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.494467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe888c4-1e83-4ed7-ad3b-f63338d81608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.494767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe888c4-1e83-4ed7-ad3b-f63338d81608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.495412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe888c4-1e83-4ed7-ad3b-f63338d81608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.497329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe888c4-1e83-4ed7-ad3b-f63338d81608 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.516422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 754/1521] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:28.517673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4096289-d562-406a-8d94-09f912d46554 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.549070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4096289-d562-406a-8d94-09f912d46554 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.566915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88da0e-e1b3-44b8-b797-285c683b606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.568175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88da0e-e1b3-44b8-b797-285c683b606f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.568175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88da0e-e1b3-44b8-b797-285c683b606f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.568777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88da0e-e1b3-44b8-b797-285c683b606f admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.569632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88da0e-e1b3-44b8-b797-285c683b606f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.575031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88da0e-e1b3-44b8-b797-285c683b606f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.588669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 768/1522] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:28 2022] POST /identity/v3/projects => generated 357 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:28.589575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe888c4-1e83-4ed7-ad3b-f63338d81608 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.610273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 755/1523] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:28 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:28.611993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88da0e-e1b3-44b8-b797-285c683b606f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.682289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe888c4-1e83-4ed7-ad3b-f63338d81608 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.686877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69225e2-edfa-48bf-a569-378bcfa1e7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.687493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69225e2-edfa-48bf-a569-378bcfa1e7de service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.687773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69225e2-edfa-48bf-a569-378bcfa1e7de service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.688072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69225e2-edfa-48bf-a569-378bcfa1e7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.698086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88da0e-e1b3-44b8-b797-285c683b606f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.764670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d0ae83a4ad4424b866897f9411391ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2548b8f01da14fed83959746cf1c8e3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.765294 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.765575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.765849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.766501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:28.767160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.768430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.769094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69225e2-edfa-48bf-a569-378bcfa1e7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.771099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69225e2-edfa-48bf-a569-378bcfa1e7de service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.781132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 756/1524] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:28.782117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.783198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 769/1525] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:28.784495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69225e2-edfa-48bf-a569-378bcfa1e7de service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.845253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:28.872030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad62e-884f-47ed-b0aa-247905c3d588 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.879009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69225e2-edfa-48bf-a569-378bcfa1e7de service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.888245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfcab1-389c-4c83-985d-83d059c424f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.889193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfcab1-389c-4c83-985d-83d059c424f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.889561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfcab1-389c-4c83-985d-83d059c424f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.889938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfcab1-389c-4c83-985d-83d059c424f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.891374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfcab1-389c-4c83-985d-83d059c424f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.892820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfcab1-389c-4c83-985d-83d059c424f3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.899379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560cb5-e0a9-4669-97d1-3985da60e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.903497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560cb5-e0a9-4669-97d1-3985da60e5ee admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.905124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560cb5-e0a9-4669-97d1-3985da60e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.905439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560cb5-e0a9-4669-97d1-3985da60e5ee admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.909237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c560cb5-e0a9-4669-97d1-3985da60e5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.909382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 770/1526] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:28.909382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfcab1-389c-4c83-985d-83d059c424f3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.909543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c560cb5-e0a9-4669-97d1-3985da60e5ee admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.920870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:28.927868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfcab1-389c-4c83-985d-83d059c424f3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.938484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee4ebe-1fbe-45a6-8590-5fa1f8423fba tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d0ae83a4ad4424b866897f9411391ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2548b8f01da14fed83959746cf1c8e3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.942043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 757/1527] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:28 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:28.942171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4ebe-1fbe-45a6-8590-5fa1f8423fba tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.942171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4ebe-1fbe-45a6-8590-5fa1f8423fba tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.942171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4ebe-1fbe-45a6-8590-5fa1f8423fba tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.942379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560cb5-e0a9-4669-97d1-3985da60e5ee admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.942463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee4ebe-1fbe-45a6-8590-5fa1f8423fba tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.942463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee4ebe-1fbe-45a6-8590-5fa1f8423fba tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.951194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560cb5-e0a9-4669-97d1-3985da60e5ee admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:28.956562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f1b10-b3aa-459b-91c3-429cd77842a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:28.957242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f1b10-b3aa-459b-91c3-429cd77842a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:28.957519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f1b10-b3aa-459b-91c3-429cd77842a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:28.957795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f1b10-b3aa-459b-91c3-429cd77842a6 admin admin] PATH_INFO: `/v3/projects/9d76b48341b44c7bbad78f04cd7427a7/users/12d3ac22ac0c488d9fb34eacae7c9450/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:28.973879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f1b10-b3aa-459b-91c3-429cd77842a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d76b48341b44c7bbad78f04cd7427a7, user_id=12d3ac22ac0c488d9fb34eacae7c9450, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:28.976178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 771/1528] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:28 2022] POST /identity/v3/projects => generated 355 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:28.976826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f1b10-b3aa-459b-91c3-429cd77842a6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:28.977697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee4ebe-1fbe-45a6-8590-5fa1f8423fba tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:28.995324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 758/1529] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:28 2022] PUT /identity/v3/projects/9d76b48341b44c7bbad78f04cd7427a7/users/12d3ac22ac0c488d9fb34eacae7c9450/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:28.996541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f1b10-b3aa-459b-91c3-429cd77842a6 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.043967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee4ebe-1fbe-45a6-8590-5fa1f8423fba tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.066030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f1b10-b3aa-459b-91c3-429cd77842a6 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.071106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5521-95a5-4336-97d0-e2eaa882cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.071718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5521-95a5-4336-97d0-e2eaa882cb0c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.072002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5521-95a5-4336-97d0-e2eaa882cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.072279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5521-95a5-4336-97d0-e2eaa882cb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.073016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc5521-95a5-4336-97d0-e2eaa882cb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.074547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc5521-95a5-4336-97d0-e2eaa882cb0c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.088966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 759/1530] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:29.088966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5521-95a5-4336-97d0-e2eaa882cb0c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.102604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce2dae-58b0-44db-850a-6199f6d6dd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.103447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce2dae-58b0-44db-850a-6199f6d6dd11 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.104088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce2dae-58b0-44db-850a-6199f6d6dd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.104435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce2dae-58b0-44db-850a-6199f6d6dd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.153663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5521-95a5-4336-97d0-e2eaa882cb0c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.158884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d0ae83a4ad4424b866897f9411391ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2548b8f01da14fed83959746cf1c8e3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.159496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.160296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.160296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.160689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:29.160993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.162576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce2dae-58b0-44db-850a-6199f6d6dd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.162711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.164232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce2dae-58b0-44db-850a-6199f6d6dd11 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.174871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 772/1531] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:29.175565 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce2dae-58b0-44db-850a-6199f6d6dd11 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.179092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 760/1532] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:29.179092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.189830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d487d-fbc4-4b08-b48e-2ca9b67ec5ee tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.192852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce2dae-58b0-44db-850a-6199f6d6dd11 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.196683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8317c6f-f008-48ce-a14c-36c5b6743cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.197731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8317c6f-f008-48ce-a14c-36c5b6743cec admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.197731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8317c6f-f008-48ce-a14c-36c5b6743cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.198836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8317c6f-f008-48ce-a14c-36c5b6743cec admin admin] PATH_INFO: `/v3/projects/648b00709bff4c72963a3901b31f3c1e/users/9dc7aa3f83a54c6ab738fed38ab124fd/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.214013 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c578905-b76a-4e7e-9987-735f09d68a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.214842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c578905-b76a-4e7e-9987-735f09d68a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.215385 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c578905-b76a-4e7e-9987-735f09d68a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.217236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8317c6f-f008-48ce-a14c-36c5b6743cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=648b00709bff4c72963a3901b31f3c1e, user_id=9dc7aa3f83a54c6ab738fed38ab124fd, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.219864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c578905-b76a-4e7e-9987-735f09d68a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.220710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c578905-b76a-4e7e-9987-735f09d68a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.222618 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c578905-b76a-4e7e-9987-735f09d68a6b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.235945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8317c6f-f008-48ce-a14c-36c5b6743cec admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.242067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 773/1533] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:29.243674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c578905-b76a-4e7e-9987-735f09d68a6b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.258598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c578905-b76a-4e7e-9987-735f09d68a6b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.259228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 761/1534] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:29 2022] PUT /identity/v3/projects/648b00709bff4c72963a3901b31f3c1e/users/9dc7aa3f83a54c6ab738fed38ab124fd/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:29.260570 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8317c6f-f008-48ce-a14c-36c5b6743cec admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.285658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:29.330881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:29.386761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8317c6f-f008-48ce-a14c-36c5b6743cec admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.397073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d0ae83a4ad4424b866897f9411391ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2548b8f01da14fed83959746cf1c8e3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.398440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.398918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.399531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] PATH_INFO: `/v3/projects/9ea5f3958a2844299b3c76ba480b15ff` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.401174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9ea5f3958a2844299b3c76ba480b15ff)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.404074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.415622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9a58c-aebb-4f86-af8b-c6d6577f0f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.416317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9a58c-aebb-4f86-af8b-c6d6577f0f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.416599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9a58c-aebb-4f86-af8b-c6d6577f0f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.416875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9a58c-aebb-4f86-af8b-c6d6577f0f8f admin admin] PATH_INFO: `/v3/projects/9d76b48341b44c7bbad78f04cd7427a7/users/12d3ac22ac0c488d9fb34eacae7c9450/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.419595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9a58c-aebb-4f86-af8b-c6d6577f0f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d76b48341b44c7bbad78f04cd7427a7, user_id=12d3ac22ac0c488d9fb34eacae7c9450, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.423130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9a58c-aebb-4f86-af8b-c6d6577f0f8f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.450308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 762/1535] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:29 2022] PUT /identity/v3/projects/9d76b48341b44c7bbad78f04cd7427a7/users/12d3ac22ac0c488d9fb34eacae7c9450/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:29.453011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9a58c-aebb-4f86-af8b-c6d6577f0f8f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.497089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea5f3958a2844299b3c76ba480b15ff', 'request_id': 'req-86d80548-425f-4e32-aee6-cf34ac16cee3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:29.561845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea5f3958a2844299b3c76ba480b15ff', 'request_id': 'req-86d80548-425f-4e32-aee6-cf34ac16cee3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:29.576777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea5f3958a2844299b3c76ba480b15ff', 'request_id': 'req-86d80548-425f-4e32-aee6-cf34ac16cee3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:29.606451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] The token cache is being invalidate because project 9ea5f3958a2844299b3c76ba480b15ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:29.607655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:29.610199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-86d80548-425f-4e32-aee6-cf34ac16cee3 tempest-VolumeQuotaClassesTest-225143424 tempest-VolumeQuotaClassesTest-225143424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:29.612453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 774/1536] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:29 2022] DELETE /identity/v3/projects/9ea5f3958a2844299b3c76ba480b15ff => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:29.615351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9279-3d43-4413-a431-65f9138e17e1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.634003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9279-3d43-4413-a431-65f9138e17e1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.634295 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9279-3d43-4413-a431-65f9138e17e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.691943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9a58c-aebb-4f86-af8b-c6d6577f0f8f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.741004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f40c9279-3d43-4413-a431-65f9138e17e1 None None] MFA Rules not processed for user `12d3ac22ac0c488d9fb34eacae7c9450`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:29.742285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f40c9279-3d43-4413-a431-65f9138e17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:29.847879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.848502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.848928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.849210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.849869 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.851532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.878886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 763/1537] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:29.884027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.886316 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:29.923693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb48c04-e69a-49b9-976d-a6a2c1c91701 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:29.939617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f4aa-850f-4ca4-92d3-0fdad95b76d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:29.940363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f4aa-850f-4ca4-92d3-0fdad95b76d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:29.940649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f4aa-850f-4ca4-92d3-0fdad95b76d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:29.940923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f4aa-850f-4ca4-92d3-0fdad95b76d2 admin admin] PATH_INFO: `/v3/projects/648b00709bff4c72963a3901b31f3c1e/users/9dc7aa3f83a54c6ab738fed38ab124fd/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:29.944148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 775/1538] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:29.947740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f4aa-850f-4ca4-92d3-0fdad95b76d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648b00709bff4c72963a3901b31f3c1e, user_id=9dc7aa3f83a54c6ab738fed38ab124fd, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:29.952505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f4aa-850f-4ca4-92d3-0fdad95b76d2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:29.965277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9279-3d43-4413-a431-65f9138e17e1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:29.968197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f40c9279-3d43-4413-a431-65f9138e17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:30.001368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 764/1539] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:29 2022] PUT /identity/v3/projects/648b00709bff4c72963a3901b31f3c1e/users/9dc7aa3f83a54c6ab738fed38ab124fd/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:30.017170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08b1a-c684-4dcd-9997-4056c923b6d4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:30.017502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08b1a-c684-4dcd-9997-4056c923b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:30.017849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08b1a-c684-4dcd-9997-4056c923b6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:30.056902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-28a08b1a-c684-4dcd-9997-4056c923b6d4 None None] MFA Rules not processed for user `9dc7aa3f83a54c6ab738fed38ab124fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:30.058311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-28a08b1a-c684-4dcd-9997-4056c923b6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:30.107858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9279-3d43-4413-a431-65f9138e17e1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:30.126297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:30.129053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:30.211930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:30.213080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:30.213429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:30.213857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:30.222734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 765/1540] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:30.223760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08b1a-c684-4dcd-9997-4056c923b6d4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:30.225689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-28a08b1a-c684-4dcd-9997-4056c923b6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:30.321847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:30.324289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:30.338993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 776/1541] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:29 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:30.340259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:30.344519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:30.366579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08b1a-c684-4dcd-9997-4056c923b6d4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:30.369443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e4074-e8ab-4528-997d-3bc55d1a1d59 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:30.375480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:30.376411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:30.376870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:30.377718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] PATH_INFO: `/v3/users/a500ff9042db4bc1b3d5b467d45350bc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:30.378168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29a031-9255-4d00-b87a-5c16f28cc1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:30.378947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a031-9255-4d00-b87a-5c16f28cc1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:30.379353 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a031-9255-4d00-b87a-5c16f28cc1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:30.379751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a031-9255-4d00-b87a-5c16f28cc1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:30.382423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a500ff9042db4bc1b3d5b467d45350bc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:30.387281 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:30.395338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29a031-9255-4d00-b87a-5c16f28cc1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:30.397154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29a031-9255-4d00-b87a-5c16f28cc1c1 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:30.435233 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 777/1542] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:30.503964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29a031-9255-4d00-b87a-5c16f28cc1c1 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:30.516377 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29a031-9255-4d00-b87a-5c16f28cc1c1 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:30.524099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc76c2-8f2b-40f7-b24e-658e696188e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:30.524467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a500ff9042db4bc1b3d5b467d45350bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:30.525199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc76c2-8f2b-40f7-b24e-658e696188e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:30.525838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc76c2-8f2b-40f7-b24e-658e696188e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:30.526113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc76c2-8f2b-40f7-b24e-658e696188e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:30.527979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1afc76c2-8f2b-40f7-b24e-658e696188e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:30.557092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a500ff9042db4bc1b3d5b467d45350bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:30.567004 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a500ff9042db4bc1b3d5b467d45350bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:30.567985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a500ff9042db4bc1b3d5b467d45350bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:30.577675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a500ff9042db4bc1b3d5b467d45350bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:30.592844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 766/1543] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:30 2022] DELETE /identity/v3/users/a500ff9042db4bc1b3d5b467d45350bc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:30.594199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:30.595967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:30.645379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc76c2-8f2b-40f7-b24e-658e696188e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:30.648758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc76c2-8f2b-40f7-b24e-658e696188e0 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:30.660830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 778/1544] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:30 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:59:30.662480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927dd6-17bf-4293-86dd-3e1c047f5931 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:30.663128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927dd6-17bf-4293-86dd-3e1c047f5931 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:30.663607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927dd6-17bf-4293-86dd-3e1c047f5931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:30.674854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:30.691467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832459e-57f1-4fa2-90a9-e02867a58701 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:30.694801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-81927dd6-17bf-4293-86dd-3e1c047f5931 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:30.696418 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-81927dd6-17bf-4293-86dd-3e1c047f5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:30.703467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:30.707295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:30.707932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:30.708394 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:30.712003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:30.798998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:30.837858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 779/1545] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:30.850385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:30.852083 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:30.870750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 767/1546] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:30.922184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81927dd6-17bf-4293-86dd-3e1c047f5931 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:30.925365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-81927dd6-17bf-4293-86dd-3e1c047f5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:31.026715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81927dd6-17bf-4293-86dd-3e1c047f5931 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:31.038481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3e68-dcba-43f4-85bb-735586478d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:31.038779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3e68-dcba-43f4-85bb-735586478d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:31.039088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3e68-dcba-43f4-85bb-735586478d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:31.039361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3e68-dcba-43f4-85bb-735586478d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:31.110041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e3e68-dcba-43f4-85bb-735586478d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:31.112249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e3e68-dcba-43f4-85bb-735586478d5c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:31.187286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 780/1547] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:32.252486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:32.254996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:32.289690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590df4-b0f1-4e09-9dd1-d9bda4126f4b service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:32.306286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:32.307254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:32.307682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:32.309285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] PATH_INFO: `/v3/projects/efa5dc25461449ff9f3fa96a19855459` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:32.313706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa5dc25461449ff9f3fa96a19855459)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:32.315970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:32.434765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa5dc25461449ff9f3fa96a19855459', 'request_id': 'req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.453560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa5dc25461449ff9f3fa96a19855459', 'request_id': 'req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.467376 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa5dc25461449ff9f3fa96a19855459', 'request_id': 'req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.495512 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] The token cache is being invalidate because project efa5dc25461449ff9f3fa96a19855459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:32.495843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.498647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.500207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 768/1548] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:32 2022] DELETE /identity/v3/projects/efa5dc25461449ff9f3fa96a19855459 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:32.504082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3e68-dcba-43f4-85bb-735586478d5c service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:32.525301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3e68-dcba-43f4-85bb-735586478d5c service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:32.666549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:32.667214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:32.667500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:32.667783 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] PATH_INFO: `/v3/users/5d0ae83a4ad4424b866897f9411391ed` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:32.669160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0ae83a4ad4424b866897f9411391ed)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:32.671092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:32.687427 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:32.688885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:32.715385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc93397-7c83-4ffa-a2f7-b0cfbbeb3aae admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:32.735121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:32.736429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:32.736429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:32.736429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] PATH_INFO: `/v3/users/eeb455955a984c85a3fae372f811a560` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:32.738134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb455955a984c85a3fae372f811a560)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:32.739997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:32.800044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0ae83a4ad4424b866897f9411391ed'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.800990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0ae83a4ad4424b866897f9411391ed'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.813154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0ae83a4ad4424b866897f9411391ed'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.834972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0ae83a4ad4424b866897f9411391ed'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.837305 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2dfd3660-8ddb-4e5d-b5e5-f0d3da1bf772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0ae83a4ad4424b866897f9411391ed'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.867184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb455955a984c85a3fae372f811a560'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.875232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 781/1549] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:32 2022] DELETE /identity/v3/users/5d0ae83a4ad4424b866897f9411391ed => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:32.914169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb455955a984c85a3fae372f811a560'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.932715 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb455955a984c85a3fae372f811a560'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.935590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb455955a984c85a3fae372f811a560'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.942746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:32.955302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb455955a984c85a3fae372f811a560'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:32.965568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 769/1550] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:32 2022] DELETE /identity/v3/users/eeb455955a984c85a3fae372f811a560 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:32.971160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ca29c-241d-4313-8094-afc7a83c4447 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:32.971432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ca29c-241d-4313-8094-afc7a83c4447 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:32.971724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ca29c-241d-4313-8094-afc7a83c4447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:32.999397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-318ca29c-241d-4313-8094-afc7a83c4447 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:33.000933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-318ca29c-241d-4313-8094-afc7a83c4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:33.007469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:33.154762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 782/1551] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:33.164822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:33.166641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:33.230631 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48e25-a3f6-41d8-8dcc-e137d487fe9a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:33.235542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:33.236333 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:33.236553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:33.236852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:33.250095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:33.251691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:33.263859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 770/1552] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:33.785563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ca29c-241d-4313-8094-afc7a83c4447 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:33.789411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-318ca29c-241d-4313-8094-afc7a83c4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:33.805459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ca29c-241d-4313-8094-afc7a83c4447 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:33.821235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:33.821901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:33.822179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:33.822675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] PATH_INFO: `/v3/projects/d6d249c59fc14df0b3a8464dff9cdca8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:33.828753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d249c59fc14df0b3a8464dff9cdca8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:33.831097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:33.936200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:33.938698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:33.941368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d249c59fc14df0b3a8464dff9cdca8', 'request_id': 'req-d8f46c5c-2b26-45e3-8276-045fd471afd1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:33.949880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d249c59fc14df0b3a8464dff9cdca8', 'request_id': 'req-d8f46c5c-2b26-45e3-8276-045fd471afd1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:33.959417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d249c59fc14df0b3a8464dff9cdca8', 'request_id': 'req-d8f46c5c-2b26-45e3-8276-045fd471afd1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:33.960453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b41d6c-508d-41e9-bd27-5e829baebe99 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:33.980913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] The token cache is being invalidate because project d6d249c59fc14df0b3a8464dff9cdca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:33.981340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:33.986398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:33.990572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 783/1553] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:33 2022] DELETE /identity/v3/projects/d6d249c59fc14df0b3a8464dff9cdca8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:33.995474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:34.000895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:34.124324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:34.124984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:34.125311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:34.125601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] PATH_INFO: `/v3/projects/2548b8f01da14fed83959746cf1c8e3d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:34.127950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2548b8f01da14fed83959746cf1c8e3d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:34.131768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:34.163568 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f46c5c-2b26-45e3-8276-045fd471afd1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:34.179202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:34.180962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:34.181269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:34.181659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] PATH_INFO: `/v3/users/5bcd4417e8c34f06b69241aab508a92c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:34.186063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcd4417e8c34f06b69241aab508a92c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:34.190194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:34.281242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2548b8f01da14fed83959746cf1c8e3d', 'request_id': 'req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.289615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2548b8f01da14fed83959746cf1c8e3d', 'request_id': 'req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.289972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:34.304387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2548b8f01da14fed83959746cf1c8e3d', 'request_id': 'req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.313010 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcd4417e8c34f06b69241aab508a92c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.314188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcd4417e8c34f06b69241aab508a92c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.329430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcd4417e8c34f06b69241aab508a92c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.331600 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] The token cache is being invalidate because project 2548b8f01da14fed83959746cf1c8e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:34.332090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.334147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5673cb23-32e7-4658-a22b-8f3f1ef0fe43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.338771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 771/1554] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:33 2022] DELETE /identity/v3/projects/2548b8f01da14fed83959746cf1c8e3d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:34.344220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415089f-a384-436e-898b-8ae551af555b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:34.344818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415089f-a384-436e-898b-8ae551af555b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:34.345233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415089f-a384-436e-898b-8ae551af555b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:34.383612 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcd4417e8c34f06b69241aab508a92c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.385063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7b1b7e12-8cbc-4e37-b2c7-51fa5c778a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcd4417e8c34f06b69241aab508a92c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:34.392877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a415089f-a384-436e-898b-8ae551af555b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:34.396317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a415089f-a384-436e-898b-8ae551af555b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:34.419329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 784/1555] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:33 2022] DELETE /identity/v3/users/5bcd4417e8c34f06b69241aab508a92c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:34.496804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:34.515175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbde84-7c40-4769-8ba1-f62fb6b68b77 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:34.516841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbde84-7c40-4769-8ba1-f62fb6b68b77 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:34.517295 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbde84-7c40-4769-8ba1-f62fb6b68b77 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:34.519405 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 785/1556] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 16:59:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 16:59:34.556097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d25c-4463-40e4-a4d0-26d5556035fc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:34.557408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d25c-4463-40e4-a4d0-26d5556035fc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:34.557865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d25c-4463-40e4-a4d0-26d5556035fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:34.643343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6367d25c-4463-40e4-a4d0-26d5556035fc None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:34.644760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6367d25c-4463-40e4-a4d0-26d5556035fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:34.703767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 772/1557] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:34.712349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d6240-0567-4aae-8470-9b70a3eded03 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:34.712644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d6240-0567-4aae-8470-9b70a3eded03 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:34.712918 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d6240-0567-4aae-8470-9b70a3eded03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:34.762987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-692d6240-0567-4aae-8470-9b70a3eded03 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:34.764761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-692d6240-0567-4aae-8470-9b70a3eded03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:34.851910 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 786/1558] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 16:59:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:34.859872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 773/1559] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:34.865486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367d25c-4463-40e4-a4d0-26d5556035fc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:34.877965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367d25c-4463-40e4-a4d0-26d5556035fc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:34.883555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:34.884462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:34.885434 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:34.885875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:34.886891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:34.887480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:34.890767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:34.910766 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 787/1560] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:34.914068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d6240-0567-4aae-8470-9b70a3eded03 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:34.926838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d6240-0567-4aae-8470-9b70a3eded03 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:34.940512 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb0f5f-c8fc-4244-8633-a2d9a185aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:34.941410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0f5f-c8fc-4244-8633-a2d9a185aa67 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:34.941946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0f5f-c8fc-4244-8633-a2d9a185aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:34.942454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0f5f-c8fc-4244-8633-a2d9a185aa67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:34.947081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb0f5f-c8fc-4244-8633-a2d9a185aa67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:34.949614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb0f5f-c8fc-4244-8633-a2d9a185aa67 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.002699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:35.004368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 774/1561] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:34 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:35.021089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee73834-b665-458f-991c-3e9446be1bd4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:35.137193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:35.137603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.139008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.139532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.141731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:35.146450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.193500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 788/1562] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:35 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:35.197826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb0f5f-c8fc-4244-8633-a2d9a185aa67 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:35.213761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb0f5f-c8fc-4244-8633-a2d9a185aa67 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:35.245809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dc62a-7a7c-4232-9648-ade3d16865ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:35.246729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dc62a-7a7c-4232-9648-ade3d16865ef admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.248188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dc62a-7a7c-4232-9648-ade3d16865ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.248547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dc62a-7a7c-4232-9648-ade3d16865ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.253851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dc62a-7a7c-4232-9648-ade3d16865ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:35.256364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dc62a-7a7c-4232-9648-ade3d16865ef admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.261070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:35.263549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:35.276208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 775/1563] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:35.277653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dc62a-7a7c-4232-9648-ade3d16865ef admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:35.297735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dc62a-7a7c-4232-9648-ade3d16865ef admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:35.307291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbcc54-0c6e-46b3-bda4-313af5c24487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:35.308992 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbcc54-0c6e-46b3-bda4-313af5c24487 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.309431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbcc54-0c6e-46b3-bda4-313af5c24487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.311307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbcc54-0c6e-46b3-bda4-313af5c24487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.312296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbcc54-0c6e-46b3-bda4-313af5c24487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:35.315782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbcc54-0c6e-46b3-bda4-313af5c24487 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.317684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:35.346547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 776/1564] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:35.347530 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbcc54-0c6e-46b3-bda4-313af5c24487 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:35.363085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbcc54-0c6e-46b3-bda4-313af5c24487 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:35.374416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:35.375177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.375925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.375925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] PATH_INFO: `/v3/projects/ff8ae4f4861541448357715544c47778/users/24460be80a1443ca878efb180f8470ed/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.416246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8ae4f4861541448357715544c47778, user_id=24460be80a1443ca878efb180f8470ed, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:35.421988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.423838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8bcd3-d0a1-4a53-a30b-e62021e5ee24 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:35.430208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eda6da-1575-4cc8-a71a-fdd4a07c5daf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:35.431597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eda6da-1575-4cc8-a71a-fdd4a07c5daf service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.431597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eda6da-1575-4cc8-a71a-fdd4a07c5daf service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.431597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eda6da-1575-4cc8-a71a-fdd4a07c5daf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.442195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eda6da-1575-4cc8-a71a-fdd4a07c5daf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:35.446097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eda6da-1575-4cc8-a71a-fdd4a07c5daf service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.453853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 777/1565] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:35 2022] PUT /identity/v3/projects/ff8ae4f4861541448357715544c47778/users/24460be80a1443ca878efb180f8470ed/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:35.455082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:35.467161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:35.482204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 789/1566] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:35.487184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080083-a299-46bd-9fd4-8d162f501955 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.488781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080083-a299-46bd-9fd4-8d162f501955 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.489071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080083-a299-46bd-9fd4-8d162f501955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.552247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-40080083-a299-46bd-9fd4-8d162f501955 None None] MFA Rules not processed for user `24460be80a1443ca878efb180f8470ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:35.553876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-40080083-a299-46bd-9fd4-8d162f501955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:35.636157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f5c6-ae1e-48af-b54f-1477650bcd67 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:35.646853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:35.647949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.648474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.648965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] PATH_INFO: `/v3/projects/105c755a8e614536a42151ea0e36713c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.651193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] RBAC: Authorizing `identity:delete_project(project_id=105c755a8e614536a42151ea0e36713c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:35.653326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.663719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:35.676576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 790/1567] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:35.681011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40080083-a299-46bd-9fd4-8d162f501955 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:35.702047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40080083-a299-46bd-9fd4-8d162f501955 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:35.708144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5223a-13ac-462d-b6d2-27d40be878d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:35.708821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5223a-13ac-462d-b6d2-27d40be878d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.709857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5223a-13ac-462d-b6d2-27d40be878d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.710339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5223a-13ac-462d-b6d2-27d40be878d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.711090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5223a-13ac-462d-b6d2-27d40be878d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:35.713374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5223a-13ac-462d-b6d2-27d40be878d9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.758166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 791/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:35 2022] POST /identity/v3/projects => generated 391 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:35.762166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5223a-13ac-462d-b6d2-27d40be878d9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:35.769921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105c755a8e614536a42151ea0e36713c', 'request_id': 'req-32ca061f-6cf9-46c4-9981-93607a33d0db'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:35.807536 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105c755a8e614536a42151ea0e36713c', 'request_id': 'req-32ca061f-6cf9-46c4-9981-93607a33d0db'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:35.816881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105c755a8e614536a42151ea0e36713c', 'request_id': 'req-32ca061f-6cf9-46c4-9981-93607a33d0db'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:35.845853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] The token cache is being invalidate because project 105c755a8e614536a42151ea0e36713c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:35.846314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:35.848852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-32ca061f-6cf9-46c4-9981-93607a33d0db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:35.855404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 778/1569] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:35 2022] DELETE /identity/v3/projects/105c755a8e614536a42151ea0e36713c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:35.860589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063913ac-554b-41c5-8b48-a1e1eb13e48c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.860877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063913ac-554b-41c5-8b48-a1e1eb13e48c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.861161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063913ac-554b-41c5-8b48-a1e1eb13e48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.898054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-063913ac-554b-41c5-8b48-a1e1eb13e48c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:35.899341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-063913ac-554b-41c5-8b48-a1e1eb13e48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:35.913845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5223a-13ac-462d-b6d2-27d40be878d9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:35.920358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 779/1570] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:35.931789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cb61e-c4b4-419c-85bc-ff2d23834084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:35.932420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cb61e-c4b4-419c-85bc-ff2d23834084 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.932700 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cb61e-c4b4-419c-85bc-ff2d23834084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.932992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cb61e-c4b4-419c-85bc-ff2d23834084 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.933276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc6668-1b6e-462c-86d7-54cb53ce4fb6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:35.933615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cb61e-c4b4-419c-85bc-ff2d23834084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:35.933725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc6668-1b6e-462c-86d7-54cb53ce4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:35.934073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc6668-1b6e-462c-86d7-54cb53ce4fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:35.936257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cb61e-c4b4-419c-85bc-ff2d23834084 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:35.964942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c9cc6668-1b6e-462c-86d7-54cb53ce4fb6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:35.967144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c9cc6668-1b6e-462c-86d7-54cb53ce4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:35.988503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 780/1571] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:35.989923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 792/1572] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:35 2022] POST /identity/v3/users => generated 302 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:35.999039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc6668-1b6e-462c-86d7-54cb53ce4fb6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.000708 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c9cc6668-1b6e-462c-86d7-54cb53ce4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:36.001541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cb61e-c4b4-419c-85bc-ff2d23834084 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.010152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:36.017650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cb61e-c4b4-419c-85bc-ff2d23834084 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.034748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.035366 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc6668-1b6e-462c-86d7-54cb53ce4fb6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.035473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.035666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.035936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.036601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:36.036906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.038655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.054409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3688-d290-4f4b-995b-cc2e803bf873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.055240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3688-d290-4f4b-995b-cc2e803bf873 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.055549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3688-d290-4f4b-995b-cc2e803bf873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.055879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3688-d290-4f4b-995b-cc2e803bf873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.056559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3688-d290-4f4b-995b-cc2e803bf873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.060466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3688-d290-4f4b-995b-cc2e803bf873 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.077069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 793/1573] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:59:36.081402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.096689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64821a2d-e21e-441c-9f97-8dde34c314dc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.104374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28550-69cb-4e13-abb7-de4c465c5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.106847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28550-69cb-4e13-abb7-de4c465c5a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.107598 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 781/1574] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:36.109800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28550-69cb-4e13-abb7-de4c465c5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.110182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28550-69cb-4e13-abb7-de4c465c5a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.111174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28550-69cb-4e13-abb7-de4c465c5a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.111684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3688-d290-4f4b-995b-cc2e803bf873 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.115315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28550-69cb-4e13-abb7-de4c465c5a5e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.129074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3688-d290-4f4b-995b-cc2e803bf873 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.137113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88500f-b404-4293-971c-2a7117145dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.137784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88500f-b404-4293-971c-2a7117145dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.138167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88500f-b404-4293-971c-2a7117145dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.138447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88500f-b404-4293-971c-2a7117145dda admin admin] PATH_INFO: `/v3/projects/2c0442fc6d2b4183a3313e658e6c6379/users/545604a090894217b66ca8c5ddbff946/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.185822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 794/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:36 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:59:36.186509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88500f-b404-4293-971c-2a7117145dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0442fc6d2b4183a3313e658e6c6379, user_id=545604a090894217b66ca8c5ddbff946, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.186838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28550-69cb-4e13-abb7-de4c465c5a5e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.190233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88500f-b404-4293-971c-2a7117145dda admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.219362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 782/1576] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:36 2022] PUT /identity/v3/projects/2c0442fc6d2b4183a3313e658e6c6379/users/545604a090894217b66ca8c5ddbff946/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:36.220454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88500f-b404-4293-971c-2a7117145dda admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.288726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28550-69cb-4e13-abb7-de4c465c5a5e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.330266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88500f-b404-4293-971c-2a7117145dda admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.337356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.338236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.338697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.339119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.339948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.341841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.353638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 783/1577] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:36.354868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.359097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:36.364963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ec74-bd0c-443a-88ea-8d0f81f916fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.365599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ec74-bd0c-443a-88ea-8d0f81f916fe admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.365879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ec74-bd0c-443a-88ea-8d0f81f916fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.366157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ec74-bd0c-443a-88ea-8d0f81f916fe admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.366848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ec74-bd0c-443a-88ea-8d0f81f916fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.370452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ec74-bd0c-443a-88ea-8d0f81f916fe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.375971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cd02f-a321-428c-90bd-c40dde7e093f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.381971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.383196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.383535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.383806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] PATH_INFO: `/v3/users/85e7496635014c2da09a0dd39222ad54` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.385497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e7496635014c2da09a0dd39222ad54)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.387683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.398843 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 795/1578] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:36 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:36.400105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ec74-bd0c-443a-88ea-8d0f81f916fe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.414889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ec74-bd0c-443a-88ea-8d0f81f916fe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.425210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2945fa6-69d1-43b2-8f51-7cbf1e35f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.426073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2945fa6-69d1-43b2-8f51-7cbf1e35f77e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.426360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2945fa6-69d1-43b2-8f51-7cbf1e35f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.426677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2945fa6-69d1-43b2-8f51-7cbf1e35f77e admin admin] PATH_INFO: `/v3/projects/2c0442fc6d2b4183a3313e658e6c6379/users/545604a090894217b66ca8c5ddbff946/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.428837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2945fa6-69d1-43b2-8f51-7cbf1e35f77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0442fc6d2b4183a3313e658e6c6379, user_id=545604a090894217b66ca8c5ddbff946, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.432713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2945fa6-69d1-43b2-8f51-7cbf1e35f77e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.450148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 796/1579] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:36 2022] PUT /identity/v3/projects/2c0442fc6d2b4183a3313e658e6c6379/users/545604a090894217b66ca8c5ddbff946/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:36.465825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2945fa6-69d1-43b2-8f51-7cbf1e35f77e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.467851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:36.498664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e7496635014c2da09a0dd39222ad54'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:36.513830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e7496635014c2da09a0dd39222ad54'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:36.523869 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e7496635014c2da09a0dd39222ad54'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:36.524632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e7496635014c2da09a0dd39222ad54'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:36.546741 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d5ba57f7-e93a-4ef5-8f4c-2a2e4c63f7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e7496635014c2da09a0dd39222ad54'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:36.562549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 784/1580] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:36 2022] DELETE /identity/v3/users/85e7496635014c2da09a0dd39222ad54 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:36.562549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51545-4773-481b-8ae3-5eaae5aad835 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.563561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51545-4773-481b-8ae3-5eaae5aad835 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.567039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f51545-4773-481b-8ae3-5eaae5aad835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.608707 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:36.640216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2945fa6-69d1-43b2-8f51-7cbf1e35f77e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.641537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-74f51545-4773-481b-8ae3-5eaae5aad835 None None] MFA Rules not processed for user `545604a090894217b66ca8c5ddbff946`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:36.643030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-74f51545-4773-481b-8ae3-5eaae5aad835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:36.784154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.784917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.785204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.785478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.786239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.787986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.798090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 785/1581] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:36.799557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478411-9028-4c87-9d2d-03a4331a7b44 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.799895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478411-9028-4c87-9d2d-03a4331a7b44 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.800230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478411-9028-4c87-9d2d-03a4331a7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.801574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 797/1582] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:36.812243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.815944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:36.836546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccef4b-4052-473e-907f-89c2770b5fb1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.841908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.842920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.843542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.843888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.845484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:36.847321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:36.860160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 798/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:36.860869 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:36.864594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:36.979265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfffcb-87ad-4964-972b-fcec332032c0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:36.981384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2a478411-9028-4c87-9d2d-03a4331a7b44 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:36.982795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2a478411-9028-4c87-9d2d-03a4331a7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:36.983997 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:36.985336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:36.985714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:36.986591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:36.992687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 786/1584] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:36.993900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a478411-9028-4c87-9d2d-03a4331a7b44 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:37.002853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:37.007647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a478411-9028-4c87-9d2d-03a4331a7b44 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:37.015085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef639e-9dab-4d83-a3cf-c1a0f4ecdcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:37.015484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef639e-9dab-4d83-a3cf-c1a0f4ecdcc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:37.015825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef639e-9dab-4d83-a3cf-c1a0f4ecdcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:37.016116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef639e-9dab-4d83-a3cf-c1a0f4ecdcc5 admin admin] PATH_INFO: `/v3/projects/3924e59c1973471d85ce86cf03f3a41a/users/e4d7fdb476f94d19b7c04bf9a05fd925/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:37.021290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:37.033363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef639e-9dab-4d83-a3cf-c1a0f4ecdcc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3924e59c1973471d85ce86cf03f3a41a, user_id=e4d7fdb476f94d19b7c04bf9a05fd925, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:37.036106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef639e-9dab-4d83-a3cf-c1a0f4ecdcc5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:37.058183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 799/1585] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:37.060928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:37.064243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:37.073048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 787/1586] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:36 2022] PUT /identity/v3/projects/3924e59c1973471d85ce86cf03f3a41a/users/e4d7fdb476f94d19b7c04bf9a05fd925/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:37.074773 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f0367-140a-417a-a736-db1ae200a387 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:37.074961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f0367-140a-417a-a736-db1ae200a387 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:37.075320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f0367-140a-417a-a736-db1ae200a387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:37.106432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e11f0367-140a-417a-a736-db1ae200a387 None None] MFA Rules not processed for user `e4d7fdb476f94d19b7c04bf9a05fd925`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:37.108483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e11f0367-140a-417a-a736-db1ae200a387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:37.194025 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:37.213810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010954-4890-43ae-af61-05140735f2cd service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:37.222881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 788/1587] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:37.222881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f0367-140a-417a-a736-db1ae200a387 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:37.222881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e11f0367-140a-417a-a736-db1ae200a387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:37.317210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:37.319999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f0367-140a-417a-a736-db1ae200a387 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:37.327936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:37.329382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:37.329681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:37.329957 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:37.331807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:37.332514 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6d45-58f9-4f3c-b4fc-777810ab087a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:37.333557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6d45-58f9-4f3c-b4fc-777810ab087a service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:37.334043 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6d45-58f9-4f3c-b4fc-777810ab087a service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:37.334562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6d45-58f9-4f3c-b4fc-777810ab087a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:37.418257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6d45-58f9-4f3c-b4fc-777810ab087a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:37.420885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6d45-58f9-4f3c-b4fc-777810ab087a service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:37.432754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 800/1588] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:37.433670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6d45-58f9-4f3c-b4fc-777810ab087a service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:37.444988 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6d45-58f9-4f3c-b4fc-777810ab087a service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:37.450813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:37.452129 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2e2a6-de7f-48cd-909f-0b85b327ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:37.452757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2e2a6-de7f-48cd-909f-0b85b327ded3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:37.453040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2e2a6-de7f-48cd-909f-0b85b327ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:37.453317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2e2a6-de7f-48cd-909f-0b85b327ded3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:37.453581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:37.453968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2e2a6-de7f-48cd-909f-0b85b327ded3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:37.455919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2e2a6-de7f-48cd-909f-0b85b327ded3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:37.466724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 789/1589] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:37.503586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:37.506248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 801/1590] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:37 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:37.538044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caddd13-b68f-433b-96c7-fadbb79df370 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:37.661816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882e4a4-1c33-43bb-b5c2-f628e500cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:37.662826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882e4a4-1c33-43bb-b5c2-f628e500cd40 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:37.663255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882e4a4-1c33-43bb-b5c2-f628e500cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:37.663702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882e4a4-1c33-43bb-b5c2-f628e500cd40 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:37.664486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882e4a4-1c33-43bb-b5c2-f628e500cd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:37.668229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882e4a4-1c33-43bb-b5c2-f628e500cd40 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:37.728551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2e2a6-de7f-48cd-909f-0b85b327ded3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:37.734662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 790/1591] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:37 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:37.748606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2e2a6-de7f-48cd-909f-0b85b327ded3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:37.763829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4452b-c3f5-4d1b-a5c9-62dd1726051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:37.764817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4452b-c3f5-4d1b-a5c9-62dd1726051b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:37.765404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4452b-c3f5-4d1b-a5c9-62dd1726051b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:37.766180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4452b-c3f5-4d1b-a5c9-62dd1726051b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:37.767075 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4452b-c3f5-4d1b-a5c9-62dd1726051b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:37.768981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4452b-c3f5-4d1b-a5c9-62dd1726051b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:37.790927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882e4a4-1c33-43bb-b5c2-f628e500cd40 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:37.797120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 802/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:37.803057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882e4a4-1c33-43bb-b5c2-f628e500cd40 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:37.819340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad257-fa0d-4c66-beb8-4c6ca7f92426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:37.820155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad257-fa0d-4c66-beb8-4c6ca7f92426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:37.820374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad257-fa0d-4c66-beb8-4c6ca7f92426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:37.820562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad257-fa0d-4c66-beb8-4c6ca7f92426 admin admin] PATH_INFO: `/v3/projects/17ad8ca771724ae190cee119b5f7aaf5/users/7784222890ca4eaea4f6d77d6684f68d/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:37.853317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad257-fa0d-4c66-beb8-4c6ca7f92426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ad8ca771724ae190cee119b5f7aaf5, user_id=7784222890ca4eaea4f6d77d6684f68d, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:37.857288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad257-fa0d-4c66-beb8-4c6ca7f92426 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:37.887387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 791/1593] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:37 2022] PUT /identity/v3/projects/17ad8ca771724ae190cee119b5f7aaf5/users/7784222890ca4eaea4f6d77d6684f68d/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:37.897221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4452b-c3f5-4d1b-a5c9-62dd1726051b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:37.910342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4452b-c3f5-4d1b-a5c9-62dd1726051b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:38.021515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce98f1-fec2-467f-9517-63d02330d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:38.022144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce98f1-fec2-467f-9517-63d02330d67f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:38.022457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce98f1-fec2-467f-9517-63d02330d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:38.022838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce98f1-fec2-467f-9517-63d02330d67f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:38.024644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce98f1-fec2-467f-9517-63d02330d67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:38.028153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce98f1-fec2-467f-9517-63d02330d67f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:38.061664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 803/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:38.063361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad257-fa0d-4c66-beb8-4c6ca7f92426 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:38.086375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad257-fa0d-4c66-beb8-4c6ca7f92426 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:38.092285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:38.093030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:38.093381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:38.093885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] PATH_INFO: `/v3/projects/17ad8ca771724ae190cee119b5f7aaf5/users/7784222890ca4eaea4f6d77d6684f68d/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:38.095915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ad8ca771724ae190cee119b5f7aaf5, user_id=7784222890ca4eaea4f6d77d6684f68d, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:38.098790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:38.111814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 792/1595] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:38 2022] PUT /identity/v3/projects/17ad8ca771724ae190cee119b5f7aaf5/users/7784222890ca4eaea4f6d77d6684f68d/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:38.123627 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:38.123775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054f14-edc2-4650-8fa9-9fe0c01714f6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:38.124584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054f14-edc2-4650-8fa9-9fe0c01714f6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:38.125014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054f14-edc2-4650-8fa9-9fe0c01714f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:38.125415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:38.131279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:38.173154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3b054f14-edc2-4650-8fa9-9fe0c01714f6 None None] MFA Rules not processed for user `7784222890ca4eaea4f6d77d6684f68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:38.174671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3b054f14-edc2-4650-8fa9-9fe0c01714f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:38.237939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:38.261628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392da7a-34b2-4172-975f-31e761301768 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:38.266363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:38.267033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:38.267310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:38.267585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] PATH_INFO: `/v3/projects/da4369afc3134a988b5f2c864153776e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:38.267707 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 804/1596] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:38.268735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4369afc3134a988b5f2c864153776e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:38.270688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:38.280307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054f14-edc2-4650-8fa9-9fe0c01714f6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:38.347945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4369afc3134a988b5f2c864153776e', 'request_id': 'req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.359387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4369afc3134a988b5f2c864153776e', 'request_id': 'req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.365601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054f14-edc2-4650-8fa9-9fe0c01714f6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:38.369071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4369afc3134a988b5f2c864153776e', 'request_id': 'req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.390543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] The token cache is being invalidate because project da4369afc3134a988b5f2c864153776e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:38.390854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.391634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.393522 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 793/1597] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:38 2022] DELETE /identity/v3/projects/da4369afc3134a988b5f2c864153776e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:38.397150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:38.398654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:38.430241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:38.430922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:38.431206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:38.431484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:38.433260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:38.465989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd534fc-d21f-4d89-a3d8-1ec03732d3ed admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:38.471474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:38.472108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:38.472384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:38.472651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] PATH_INFO: `/v3/users/12d3ac22ac0c488d9fb34eacae7c9450` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:38.473801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d3ac22ac0c488d9fb34eacae7c9450)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:38.475745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:38.501185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:38.502826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:38.513620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 805/1598] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:38.515850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:38.527556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d3ac22ac0c488d9fb34eacae7c9450'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.549868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d3ac22ac0c488d9fb34eacae7c9450'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.560617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d3ac22ac0c488d9fb34eacae7c9450'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.561442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d3ac22ac0c488d9fb34eacae7c9450'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.570443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b831f193-bb75-4acb-8546-71742f44a152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d3ac22ac0c488d9fb34eacae7c9450'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.578173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 794/1599] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:38 2022] DELETE /identity/v3/users/12d3ac22ac0c488d9fb34eacae7c9450 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:38.671386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:38.673441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:38.690213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbba87-dcb6-4485-8b05-83f09fe50c75 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:38.748922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:38.763501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:38.764254 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:38.765290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:38.765606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] PATH_INFO: `/v3/users/e4d7fdb476f94d19b7c04bf9a05fd925` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:38.767787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d7fdb476f94d19b7c04bf9a05fd925)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:38.770220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:38.843008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d7fdb476f94d19b7c04bf9a05fd925'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.844168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d7fdb476f94d19b7c04bf9a05fd925'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.852897 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d7fdb476f94d19b7c04bf9a05fd925'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.871182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d7fdb476f94d19b7c04bf9a05fd925'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.872232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d7fdb476f94d19b7c04bf9a05fd925'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:38.909453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 806/1600] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:38 2022] DELETE /identity/v3/users/e4d7fdb476f94d19b7c04bf9a05fd925 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:38.914357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752f94-370c-46ef-bb54-85fdea54bb74 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:38.914651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752f94-370c-46ef-bb54-85fdea54bb74 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:38.914974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752f94-370c-46ef-bb54-85fdea54bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:38.926998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:38.931639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:38.947891 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7a752f94-370c-46ef-bb54-85fdea54bb74 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:38.956778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7a752f94-370c-46ef-bb54-85fdea54bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:39.034994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 795/1601] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:39.041874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752f94-370c-46ef-bb54-85fdea54bb74 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:39.047898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5925cd-359e-463f-aaaa-57a5b8ff3889 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:39.048478 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7a752f94-370c-46ef-bb54-85fdea54bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:39.055301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:39.055958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:39.056240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:39.056518 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] PATH_INFO: `/v3/projects/9d76b48341b44c7bbad78f04cd7427a7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:39.057986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d76b48341b44c7bbad78f04cd7427a7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:39.060485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:39.142978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d76b48341b44c7bbad78f04cd7427a7', 'request_id': 'req-be18d340-6ecc-4e8c-96cb-91a4b0614f21'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:39.163714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752f94-370c-46ef-bb54-85fdea54bb74 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:39.172298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d76b48341b44c7bbad78f04cd7427a7', 'request_id': 'req-be18d340-6ecc-4e8c-96cb-91a4b0614f21'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:39.183077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d76b48341b44c7bbad78f04cd7427a7', 'request_id': 'req-be18d340-6ecc-4e8c-96cb-91a4b0614f21'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:39.201289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:39.211401 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] The token cache is being invalidate because project 9d76b48341b44c7bbad78f04cd7427a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:39.211716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:39.214749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-be18d340-6ecc-4e8c-96cb-91a4b0614f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:39.219228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 807/1602] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:38 2022] DELETE /identity/v3/projects/9d76b48341b44c7bbad78f04cd7427a7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:39.238005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591a0f-762c-4eea-bcdc-c069c140c103 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:39.238336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591a0f-762c-4eea-bcdc-c069c140c103 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:39.240415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591a0f-762c-4eea-bcdc-c069c140c103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:39.249719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e4e5e-6139-478d-bda2-b2a2dd484e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:39.250461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4e5e-6139-478d-bda2-b2a2dd484e83 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:39.250461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4e5e-6139-478d-bda2-b2a2dd484e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:39.250670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4e5e-6139-478d-bda2-b2a2dd484e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:39.252815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bd9e4e5e-6139-478d-bda2-b2a2dd484e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:39.288691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:39.298688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7f591a0f-762c-4eea-bcdc-c069c140c103 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:39.300307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7f591a0f-762c-4eea-bcdc-c069c140c103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:39.384884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4e5e-6139-478d-bda2-b2a2dd484e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:39.388996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4e5e-6139-478d-bda2-b2a2dd484e83 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:39.397976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 796/1603] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:59:39.440807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 808/1604] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:39.450080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b288e5c-b5b5-40dc-955c-9b58a359d694 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:39.450953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b288e5c-b5b5-40dc-955c-9b58a359d694 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:39.451230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b288e5c-b5b5-40dc-955c-9b58a359d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:39.500737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4b288e5c-b5b5-40dc-955c-9b58a359d694 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:39.505308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4b288e5c-b5b5-40dc-955c-9b58a359d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:39.531605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 797/1605] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:39.534752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f591a0f-762c-4eea-bcdc-c069c140c103 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:39.548381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f591a0f-762c-4eea-bcdc-c069c140c103 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:39.555799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:39.556769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:39.557338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:39.557920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:39.558844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:39.559512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:39.562603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:39.590258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 809/1606] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:59:39.596319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b288e5c-b5b5-40dc-955c-9b58a359d694 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:39.608221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b288e5c-b5b5-40dc-955c-9b58a359d694 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:39.619682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:39.620464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:39.620756 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:39.621030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:39.621852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:39.628510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:39.689328 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:39.689933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 798/1607] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:39 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:39.704112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189f411-6258-4a14-8f7e-e325c741e23c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:39.905812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85203f9d-7eee-4e74-98d4-ff9998ead08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:39.906605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85203f9d-7eee-4e74-98d4-ff9998ead08d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:39.906882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85203f9d-7eee-4e74-98d4-ff9998ead08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:39.907539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85203f9d-7eee-4e74-98d4-ff9998ead08d admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:39.912986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85203f9d-7eee-4e74-98d4-ff9998ead08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:39.919033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:39.921824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:39.922706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85203f9d-7eee-4e74-98d4-ff9998ead08d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:39.938627 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6d4ea-3f28-4c49-bd68-c6bdfa02d02c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:39.944820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:39.945653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:39.946062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:39.946439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] PATH_INFO: `/v3/projects/3924e59c1973471d85ce86cf03f3a41a` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:39.948082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3924e59c1973471d85ce86cf03f3a41a)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:39.950130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.008985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 810/1608] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:39 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:59:40.017035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85203f9d-7eee-4e74-98d4-ff9998ead08d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.051169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85203f9d-7eee-4e74-98d4-ff9998ead08d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.076068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3924e59c1973471d85ce86cf03f3a41a', 'request_id': 'req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.084060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3924e59c1973471d85ce86cf03f3a41a', 'request_id': 'req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.095744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3924e59c1973471d85ce86cf03f3a41a', 'request_id': 'req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.118662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] The token cache is being invalidate because project 3924e59c1973471d85ce86cf03f3a41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:40.119210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.119853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.126575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 799/1609] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:39 2022] DELETE /identity/v3/projects/3924e59c1973471d85ce86cf03f3a41a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:40.128222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.130132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:40.161269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.163163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.163726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.164371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.166297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.168258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.211340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 811/1610] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:40.215672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.220732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:40.244852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d348d4-b4ed-422e-be8c-9e3026ce0e8d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.257304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.257963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.258241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.258675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] PATH_INFO: `/v3/users/7784222890ca4eaea4f6d77d6684f68d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.259705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7784222890ca4eaea4f6d77d6684f68d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.260851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fbe9-7d06-4d0c-90ed-a0e8dba84f3b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.261626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.276349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de3be-9ac2-430c-89d3-a293e5c6288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.276974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de3be-9ac2-430c-89d3-a293e5c6288a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.277329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de3be-9ac2-430c-89d3-a293e5c6288a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.277616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de3be-9ac2-430c-89d3-a293e5c6288a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.278172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5de3be-9ac2-430c-89d3-a293e5c6288a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.280546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5de3be-9ac2-430c-89d3-a293e5c6288a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.287090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:40.292369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:40.306683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 812/1611] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:40.307517 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de3be-9ac2-430c-89d3-a293e5c6288a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.319626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de3be-9ac2-430c-89d3-a293e5c6288a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.331841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d6dc8-e087-4adb-a242-66aac55db6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.332458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d6dc8-e087-4adb-a242-66aac55db6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.332762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d6dc8-e087-4adb-a242-66aac55db6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.333015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d6dc8-e087-4adb-a242-66aac55db6e4 admin admin] PATH_INFO: `/v3/projects/39fbd711919e4661a7dcd45bf2329070/users/314bfc886ac7438ea2e2735f22fc33c9/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.359438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d6dc8-e087-4adb-a242-66aac55db6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fbd711919e4661a7dcd45bf2329070, user_id=314bfc886ac7438ea2e2735f22fc33c9, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.363498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d6dc8-e087-4adb-a242-66aac55db6e4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.369753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7784222890ca4eaea4f6d77d6684f68d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.385899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 813/1612] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:40 2022] PUT /identity/v3/projects/39fbd711919e4661a7dcd45bf2329070/users/314bfc886ac7438ea2e2735f22fc33c9/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:40.391487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7784222890ca4eaea4f6d77d6684f68d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.396573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4105-2d3f-4fcb-b8fd-1b4ab7c2c899 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.396858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4105-2d3f-4fcb-b8fd-1b4ab7c2c899 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.397247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d4105-2d3f-4fcb-b8fd-1b4ab7c2c899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.400366 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7784222890ca4eaea4f6d77d6684f68d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.401310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7784222890ca4eaea4f6d77d6684f68d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.416144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7784222890ca4eaea4f6d77d6684f68d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:40.431813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 800/1613] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:40 2022] DELETE /identity/v3/users/7784222890ca4eaea4f6d77d6684f68d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:40.440258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e09d4105-2d3f-4fcb-b8fd-1b4ab7c2c899 None None] MFA Rules not processed for user `314bfc886ac7438ea2e2735f22fc33c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:40.441510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e09d4105-2d3f-4fcb-b8fd-1b4ab7c2c899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:40.563589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 814/1614] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:40.568463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.571362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:40.673538 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc24b9d-b67f-41c6-a0b4-16d1b51ff4ac admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.682400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69831a7-2fcf-482b-831b-59ebdabcdc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.684050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69831a7-2fcf-482b-831b-59ebdabcdc08 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.684343 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69831a7-2fcf-482b-831b-59ebdabcdc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.685239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69831a7-2fcf-482b-831b-59ebdabcdc08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.686197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69831a7-2fcf-482b-831b-59ebdabcdc08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.688597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69831a7-2fcf-482b-831b-59ebdabcdc08 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.739637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 801/1615] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:40 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:40.743754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d4105-2d3f-4fcb-b8fd-1b4ab7c2c899 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.756957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d4105-2d3f-4fcb-b8fd-1b4ab7c2c899 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.826757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.827378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.827662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.827939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.828595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.830569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.857015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 815/1616] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:40 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:40.861622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69831a7-2fcf-482b-831b-59ebdabcdc08 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.873915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69831a7-2fcf-482b-831b-59ebdabcdc08 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.874166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.878858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:40.880509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba548c-ed64-4bab-8494-cea8acff6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.881275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba548c-ed64-4bab-8494-cea8acff6153 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.881622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba548c-ed64-4bab-8494-cea8acff6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.881904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba548c-ed64-4bab-8494-cea8acff6153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.882770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba548c-ed64-4bab-8494-cea8acff6153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.884894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba548c-ed64-4bab-8494-cea8acff6153 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.902881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 802/1617] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:40.905461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5a43-2a18-4a3a-b561-debfb95c8b63 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.907655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba548c-ed64-4bab-8494-cea8acff6153 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:40.916369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.918765 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.919822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.920384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] PATH_INFO: `/v3/projects/17ad8ca771724ae190cee119b5f7aaf5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.923907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ad8ca771724ae190cee119b5f7aaf5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.928651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba548c-ed64-4bab-8494-cea8acff6153 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:40.930366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.953889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c715e-00ce-4a58-b0eb-3fccb753fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:40.955652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c715e-00ce-4a58-b0eb-3fccb753fc64 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:40.955938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c715e-00ce-4a58-b0eb-3fccb753fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:40.956767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c715e-00ce-4a58-b0eb-3fccb753fc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:40.958871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c715e-00ce-4a58-b0eb-3fccb753fc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:40.961140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c715e-00ce-4a58-b0eb-3fccb753fc64 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:40.992233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 803/1618] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:40.994085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c715e-00ce-4a58-b0eb-3fccb753fc64 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.009902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c715e-00ce-4a58-b0eb-3fccb753fc64 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.030266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f87c-57a3-4df2-9180-f028644a8375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.031006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f87c-57a3-4df2-9180-f028644a8375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.031282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f87c-57a3-4df2-9180-f028644a8375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.031554 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f87c-57a3-4df2-9180-f028644a8375 admin admin] PATH_INFO: `/v3/projects/4eb7d5b4204e4dab8b5ce8cd6d064c34/users/a2e4666b5e414325a9727ff6b44af19a/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.047436 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ad8ca771724ae190cee119b5f7aaf5', 'request_id': 'req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:41.048567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45f87c-57a3-4df2-9180-f028644a8375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb7d5b4204e4dab8b5ce8cd6d064c34, user_id=a2e4666b5e414325a9727ff6b44af19a, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.049074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:41.051509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45f87c-57a3-4df2-9180-f028644a8375 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.057007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ad8ca771724ae190cee119b5f7aaf5', 'request_id': 'req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:41.066204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ad8ca771724ae190cee119b5f7aaf5', 'request_id': 'req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:41.066939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 804/1619] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:40 2022] PUT /identity/v3/projects/4eb7d5b4204e4dab8b5ce8cd6d064c34/users/a2e4666b5e414325a9727ff6b44af19a/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:41.079197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001361-a05e-4037-a475-bae4fb9a816d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.079410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001361-a05e-4037-a475-bae4fb9a816d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.079687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001361-a05e-4037-a475-bae4fb9a816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.082352 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] The token cache is being invalidate because project 17ad8ca771724ae190cee119b5f7aaf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:41.082728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:41.083373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e3a020c7-0aae-4f2d-b9d1-346160a47cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:41.085493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 816/1620] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:40 2022] DELETE /identity/v3/projects/17ad8ca771724ae190cee119b5f7aaf5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:41.090482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671854b-a666-4bdb-b194-bf2ac0c46dea None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.091695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671854b-a666-4bdb-b194-bf2ac0c46dea None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.092223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671854b-a666-4bdb-b194-bf2ac0c46dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.112580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d8001361-a05e-4037-a475-bae4fb9a816d None None] MFA Rules not processed for user `a2e4666b5e414325a9727ff6b44af19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:41.113898 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d8001361-a05e-4037-a475-bae4fb9a816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:41.116963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5671854b-a666-4bdb-b194-bf2ac0c46dea None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:41.118409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5671854b-a666-4bdb-b194-bf2ac0c46dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:41.135023 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:41.193420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 817/1621] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:41.193810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 805/1622] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:41.201894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8001361-a05e-4037-a475-bae4fb9a816d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.202609 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377d2de-ef4b-4e02-98d6-376b744fadda None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.202905 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377d2de-ef4b-4e02-98d6-376b744fadda None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.203185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377d2de-ef4b-4e02-98d6-376b744fadda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.203905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d8001361-a05e-4037-a475-bae4fb9a816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:41.219134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8001361-a05e-4037-a475-bae4fb9a816d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.223980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e15766-c90a-438f-8550-3cbf0688f31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.224595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e15766-c90a-438f-8550-3cbf0688f31e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.224918 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e15766-c90a-438f-8550-3cbf0688f31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.225126 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e15766-c90a-438f-8550-3cbf0688f31e admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.225886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e15766-c90a-438f-8550-3cbf0688f31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.227789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e15766-c90a-438f-8550-3cbf0688f31e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.228044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9377d2de-ef4b-4e02-98d6-376b744fadda None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:41.229309 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9377d2de-ef4b-4e02-98d6-376b744fadda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:41.245109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 818/1623] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:41.251725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377d2de-ef4b-4e02-98d6-376b744fadda None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.262487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377d2de-ef4b-4e02-98d6-376b744fadda None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.268962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.269638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.270021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.270450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.271130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:41.271498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.273362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.284877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 806/1624] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:41 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:41.288432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e15766-c90a-438f-8550-3cbf0688f31e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.296348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 819/1625] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:41.301376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.317888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550901b-ccd4-4a3d-9d38-926bae4e83ac admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.433866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e6a18-7808-4dc8-a5ef-3b714a88ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.435546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e6a18-7808-4dc8-a5ef-3b714a88ae8c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.436103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e6a18-7808-4dc8-a5ef-3b714a88ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.436552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e6a18-7808-4dc8-a5ef-3b714a88ae8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.437429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e6a18-7808-4dc8-a5ef-3b714a88ae8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.438916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e15766-c90a-438f-8550-3cbf0688f31e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.440645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e6a18-7808-4dc8-a5ef-3b714a88ae8c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.447252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d885163-4fde-4fcd-8c4f-1258e5660932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.447974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d885163-4fde-4fcd-8c4f-1258e5660932 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.448410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d885163-4fde-4fcd-8c4f-1258e5660932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.448929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d885163-4fde-4fcd-8c4f-1258e5660932 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.451180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d885163-4fde-4fcd-8c4f-1258e5660932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.454453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d885163-4fde-4fcd-8c4f-1258e5660932 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.482673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 820/1626] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:41 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:41.487109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e6a18-7808-4dc8-a5ef-3b714a88ae8c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.490393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 807/1627] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:41 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:41.491454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d885163-4fde-4fcd-8c4f-1258e5660932 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.504253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d885163-4fde-4fcd-8c4f-1258e5660932 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.621678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:41.642488 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e6a18-7808-4dc8-a5ef-3b714a88ae8c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.650162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843b21-580f-4529-8167-233a2d3c5d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.652258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843b21-580f-4529-8167-233a2d3c5d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.652574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843b21-580f-4529-8167-233a2d3c5d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.652921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843b21-580f-4529-8167-233a2d3c5d40 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.653758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47843b21-580f-4529-8167-233a2d3c5d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.660785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47843b21-580f-4529-8167-233a2d3c5d40 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.667410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1534-8000-4fad-b77b-208e7b9573d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.669877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1534-8000-4fad-b77b-208e7b9573d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.670379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1534-8000-4fad-b77b-208e7b9573d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.671348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1534-8000-4fad-b77b-208e7b9573d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.672084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1534-8000-4fad-b77b-208e7b9573d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.677319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1534-8000-4fad-b77b-208e7b9573d5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.708340 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 808/1628] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:41.709762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1534-8000-4fad-b77b-208e7b9573d5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.712982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 821/1629] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:41 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:41.716629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843b21-580f-4529-8167-233a2d3c5d40 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.735046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1534-8000-4fad-b77b-208e7b9573d5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.738136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843b21-580f-4529-8167-233a2d3c5d40 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.740740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a298ec-aee3-46a0-8cd6-535a474e68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.741746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a298ec-aee3-46a0-8cd6-535a474e68f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.742167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a298ec-aee3-46a0-8cd6-535a474e68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.742694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a298ec-aee3-46a0-8cd6-535a474e68f1 admin admin] PATH_INFO: `/v3/projects/d360cb9910cf4846acf627c96474e9a3/users/528dc3d702054274a6591e42e664488a/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.748706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63affe19-5fdf-454d-9420-8634e8ce8daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.749504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affe19-5fdf-454d-9420-8634e8ce8daf admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.749793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affe19-5fdf-454d-9420-8634e8ce8daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.750123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affe19-5fdf-454d-9420-8634e8ce8daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.751744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63affe19-5fdf-454d-9420-8634e8ce8daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.756288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63affe19-5fdf-454d-9420-8634e8ce8daf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.777396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a298ec-aee3-46a0-8cd6-535a474e68f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d360cb9910cf4846acf627c96474e9a3, user_id=528dc3d702054274a6591e42e664488a, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.782907 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a298ec-aee3-46a0-8cd6-535a474e68f1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.788070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 822/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:41.793487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63affe19-5fdf-454d-9420-8634e8ce8daf admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.802207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:41.818257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 809/1631] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:41 2022] PUT /identity/v3/projects/d360cb9910cf4846acf627c96474e9a3/users/528dc3d702054274a6591e42e664488a/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:41.820537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a298ec-aee3-46a0-8cd6-535a474e68f1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.827219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63affe19-5fdf-454d-9420-8634e8ce8daf admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.947906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a298ec-aee3-46a0-8cd6-535a474e68f1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.952946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.953641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.953905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.954438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.955263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.957183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.959802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59892766-5c80-4af6-aee0-77d2493e12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.960519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59892766-5c80-4af6-aee0-77d2493e12c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.960870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59892766-5c80-4af6-aee0-77d2493e12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.961214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59892766-5c80-4af6-aee0-77d2493e12c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.961933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59892766-5c80-4af6-aee0-77d2493e12c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:41.963629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59892766-5c80-4af6-aee0-77d2493e12c6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:41.976035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 810/1632] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:41.977104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.979953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 823/1633] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:41.980665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:41.980834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59892766-5c80-4af6-aee0-77d2493e12c6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:41.992090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59892766-5c80-4af6-aee0-77d2493e12c6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.994756 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904f12-9ed9-4735-aeb0-77fcc697d94f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:41.997064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2621c-633a-49bc-82e1-5aec13a71f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:41.997718 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2621c-633a-49bc-82e1-5aec13a71f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:41.998000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2621c-633a-49bc-82e1-5aec13a71f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:41.998276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2621c-633a-49bc-82e1-5aec13a71f83 admin admin] PATH_INFO: `/v3/projects/d360cb9910cf4846acf627c96474e9a3/users/528dc3d702054274a6591e42e664488a/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:41.999768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:42.000203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2621c-633a-49bc-82e1-5aec13a71f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d360cb9910cf4846acf627c96474e9a3, user_id=528dc3d702054274a6591e42e664488a, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.000533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.000879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.001223 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] PATH_INFO: `/v3/users/24460be80a1443ca878efb180f8470ed` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.002566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24460be80a1443ca878efb180f8470ed)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.002926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2621c-633a-49bc-82e1-5aec13a71f83 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.005100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.015278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 824/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:41 2022] PUT /identity/v3/projects/d360cb9910cf4846acf627c96474e9a3/users/528dc3d702054274a6591e42e664488a/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:42.016456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2621c-633a-49bc-82e1-5aec13a71f83 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:42.062345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24460be80a1443ca878efb180f8470ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:42.076029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24460be80a1443ca878efb180f8470ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:42.085690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24460be80a1443ca878efb180f8470ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:42.086967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24460be80a1443ca878efb180f8470ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:42.098806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e1f4c5ad-ef8b-4c3c-b188-4ae5b252b0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24460be80a1443ca878efb180f8470ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:42.110701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 811/1635] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:41 2022] DELETE /identity/v3/users/24460be80a1443ca878efb180f8470ed => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:42.110701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8487-7595-4e49-8000-2a36e53cb1ce None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.110701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8487-7595-4e49-8000-2a36e53cb1ce None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.110701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8487-7595-4e49-8000-2a36e53cb1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.115280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2621c-633a-49bc-82e1-5aec13a71f83 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:42.146705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-601a8487-7595-4e49-8000-2a36e53cb1ce None None] MFA Rules not processed for user `528dc3d702054274a6591e42e664488a`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:42.148021 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-601a8487-7595-4e49-8000-2a36e53cb1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:42.177656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:42.191981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9af766-0e38-480d-8c04-f92b2a1038a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:42.192671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af766-0e38-480d-8c04-f92b2a1038a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.193837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af766-0e38-480d-8c04-f92b2a1038a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.194128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af766-0e38-480d-8c04-f92b2a1038a8 admin admin] PATH_INFO: `/v3/projects/fc8aceb0732f4084b1b619e8d30a4307/users/3f742cdac49348efa010f7148d1d4de0/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.211205 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9af766-0e38-480d-8c04-f92b2a1038a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8aceb0732f4084b1b619e8d30a4307, user_id=3f742cdac49348efa010f7148d1d4de0, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.214279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9af766-0e38-480d-8c04-f92b2a1038a8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.226379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:42.230109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 825/1636] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:42 2022] PUT /identity/v3/projects/fc8aceb0732f4084b1b619e8d30a4307/users/3f742cdac49348efa010f7148d1d4de0/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:42.241422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfa78-7069-453d-bb9e-ee512c8e2ebf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.241810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfa78-7069-453d-bb9e-ee512c8e2ebf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.242144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfa78-7069-453d-bb9e-ee512c8e2ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.243635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 812/1637] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:42.244893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40470f2-e04e-4299-879e-e55f04e32034 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.245179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40470f2-e04e-4299-879e-e55f04e32034 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.245452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40470f2-e04e-4299-879e-e55f04e32034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.276934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c03cfa78-7069-453d-bb9e-ee512c8e2ebf None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:42.278150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c03cfa78-7069-453d-bb9e-ee512c8e2ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:42.289472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f40470f2-e04e-4299-879e-e55f04e32034 None None] MFA Rules not processed for user `3f742cdac49348efa010f7148d1d4de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:42.291016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f40470f2-e04e-4299-879e-e55f04e32034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:42.365099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 826/1638] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:42.366325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfa78-7069-453d-bb9e-ee512c8e2ebf None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:42.367802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c03cfa78-7069-453d-bb9e-ee512c8e2ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:42.372435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 813/1639] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:42.376608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40470f2-e04e-4299-879e-e55f04e32034 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:42.377934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f40470f2-e04e-4299-879e-e55f04e32034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:42.437481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfa78-7069-453d-bb9e-ee512c8e2ebf None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:42.438618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40470f2-e04e-4299-879e-e55f04e32034 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:42.441639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:42.442252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.442357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:42.442807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.442999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.443153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.443254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.443517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.444934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:42.454509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.456271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.467702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 814/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:42.475482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:42.477225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:42.492835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc56d6f-c2da-4a1a-8824-60a0ad713397 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:42.500700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6670d-0a39-4761-8120-8cb0c0a6c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:42.503685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6670d-0a39-4761-8120-8cb0c0a6c482 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.504326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6670d-0a39-4761-8120-8cb0c0a6c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.504326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6670d-0a39-4761-8120-8cb0c0a6c482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.504988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6670d-0a39-4761-8120-8cb0c0a6c482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.508194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6670d-0a39-4761-8120-8cb0c0a6c482 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.521629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.522907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.537737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 827/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:42.585469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 815/1642] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:42 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:42.590535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:42.613167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692ad93-1c24-4937-a3df-1f92925f24dd service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:42.658617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:42.721204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f105e4-2147-4a12-9642-4a76d1fd2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:42.724577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f105e4-2147-4a12-9642-4a76d1fd2581 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.725673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f105e4-2147-4a12-9642-4a76d1fd2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.726052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f105e4-2147-4a12-9642-4a76d1fd2581 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.726743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f105e4-2147-4a12-9642-4a76d1fd2581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.728836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f105e4-2147-4a12-9642-4a76d1fd2581 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.761314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 828/1643] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:42 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:42.765950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6670d-0a39-4761-8120-8cb0c0a6c482 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:42.779720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6670d-0a39-4761-8120-8cb0c0a6c482 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:42.789973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bdd16-2401-46b0-adb7-f4c0104024c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:42.792445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bdd16-2401-46b0-adb7-f4c0104024c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.792445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bdd16-2401-46b0-adb7-f4c0104024c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.792798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bdd16-2401-46b0-adb7-f4c0104024c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.793387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bdd16-2401-46b0-adb7-f4c0104024c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.795572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bdd16-2401-46b0-adb7-f4c0104024c2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.811681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 816/1644] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:42.813937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f105e4-2147-4a12-9642-4a76d1fd2581 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:42.836172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f105e4-2147-4a12-9642-4a76d1fd2581 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:42.851389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:42.852090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:42.852395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:42.852669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] PATH_INFO: `/v3/projects/4d7466149ff6445f994066a66b5dc3c7/users/03a97a0f262d4e55a417cbf4a44fd699/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:42.879603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7466149ff6445f994066a66b5dc3c7, user_id=03a97a0f262d4e55a417cbf4a44fd699, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:42.882288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:42.915238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 829/1645] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:42 2022] PUT /identity/v3/projects/4d7466149ff6445f994066a66b5dc3c7/users/03a97a0f262d4e55a417cbf4a44fd699/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:42.919232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bdd16-2401-46b0-adb7-f4c0104024c2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:42.943582 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bdd16-2401-46b0-adb7-f4c0104024c2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:43.047947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:43.050325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:43.054605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:43.083093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0289-e6a9-409e-ad6f-28a99f5d3ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:43.083877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0289-e6a9-409e-ad6f-28a99f5d3ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:43.084399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0289-e6a9-409e-ad6f-28a99f5d3ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:43.084647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0289-e6a9-409e-ad6f-28a99f5d3ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:43.085309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f0289-e6a9-409e-ad6f-28a99f5d3ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:43.088024 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f0289-e6a9-409e-ad6f-28a99f5d3ad3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:43.112194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 817/1646] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:43.113354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0289-e6a9-409e-ad6f-28a99f5d3ad3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:43.127072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0289-e6a9-409e-ad6f-28a99f5d3ad3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:43.145600 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e40f72-eb08-4e45-b1c9-b6f3aa4e11e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:43.146391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40f72-eb08-4e45-b1c9-b6f3aa4e11e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:43.146791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40f72-eb08-4e45-b1c9-b6f3aa4e11e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:43.147206 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40f72-eb08-4e45-b1c9-b6f3aa4e11e7 admin admin] PATH_INFO: `/v3/projects/4d7466149ff6445f994066a66b5dc3c7/users/03a97a0f262d4e55a417cbf4a44fd699/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:43.155153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e40f72-eb08-4e45-b1c9-b6f3aa4e11e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7466149ff6445f994066a66b5dc3c7, user_id=03a97a0f262d4e55a417cbf4a44fd699, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:43.161252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e40f72-eb08-4e45-b1c9-b6f3aa4e11e7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:43.181568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 818/1647] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:43 2022] PUT /identity/v3/projects/4d7466149ff6445f994066a66b5dc3c7/users/03a97a0f262d4e55a417cbf4a44fd699/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:43.193469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59c87f-5519-40a5-980c-b9bfb1751da8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:43.194066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59c87f-5519-40a5-980c-b9bfb1751da8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:43.194387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59c87f-5519-40a5-980c-b9bfb1751da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:43.217749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6597a9-3ab5-4035-b1fa-1a502a69fbc8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:43.238197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5f59c87f-5519-40a5-980c-b9bfb1751da8 None None] MFA Rules not processed for user `03a97a0f262d4e55a417cbf4a44fd699`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:43.239551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5f59c87f-5519-40a5-980c-b9bfb1751da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:43.297213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:43.297859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:43.298170 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:43.298542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] PATH_INFO: `/v3/projects/ff8ae4f4861541448357715544c47778` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:43.299789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8ae4f4861541448357715544c47778)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:43.302069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:43.340171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 819/1648] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:43.359004 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59c87f-5519-40a5-980c-b9bfb1751da8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:43.360579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5f59c87f-5519-40a5-980c-b9bfb1751da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:43.390836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:43.396268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8ae4f4861541448357715544c47778', 'request_id': 'req-c95715cc-102c-4f69-8e2a-825f2b18b4be'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.406053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8ae4f4861541448357715544c47778', 'request_id': 'req-c95715cc-102c-4f69-8e2a-825f2b18b4be'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.415112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8ae4f4861541448357715544c47778', 'request_id': 'req-c95715cc-102c-4f69-8e2a-825f2b18b4be'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.431977 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] The token cache is being invalidate because project ff8ae4f4861541448357715544c47778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:43.432377 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.433143 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.435992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 830/1649] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:43 2022] DELETE /identity/v3/projects/ff8ae4f4861541448357715544c47778 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:43.439540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:43.441948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:43.444767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59c87f-5519-40a5-980c-b9bfb1751da8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:43.543642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:43.548330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:43.549007 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:43.551213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:43.556382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:43.563134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95715cc-102c-4f69-8e2a-825f2b18b4be admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:43.593921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:43.594896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:43.595181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:43.595516 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] PATH_INFO: `/v3/users/545604a090894217b66ca8c5ddbff946` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:43.598437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545604a090894217b66ca8c5ddbff946)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:43.603749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:43.625784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:43.677068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:43.679368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:43.686925 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545604a090894217b66ca8c5ddbff946'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.687880 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545604a090894217b66ca8c5ddbff946'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.693927 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 820/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:43.711873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545604a090894217b66ca8c5ddbff946'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.732962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545604a090894217b66ca8c5ddbff946'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.734652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545604a090894217b66ca8c5ddbff946'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:43.752576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 831/1651] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:43 2022] DELETE /identity/v3/users/545604a090894217b66ca8c5ddbff946 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:43.795611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:43.797329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:43.810397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d6d4-aa12-445a-80a8-3429d34028e4 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:43.877225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc048af-bb8e-4380-a295-d5f8f21b2dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:43.878288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc048af-bb8e-4380-a295-d5f8f21b2dcb service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:43.879157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc048af-bb8e-4380-a295-d5f8f21b2dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:43.879813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc048af-bb8e-4380-a295-d5f8f21b2dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:43.883827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4cc048af-bb8e-4380-a295-d5f8f21b2dcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:43.960975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc048af-bb8e-4380-a295-d5f8f21b2dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:43.962432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc048af-bb8e-4380-a295-d5f8f21b2dcb service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:43.977594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 821/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:44.073959 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:44.078438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:44.154498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:44.183786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357df749-109d-4761-a4a2-6cb293994716 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:44.190231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:44.191030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.191308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.191628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] PATH_INFO: `/v3/projects/2c0442fc6d2b4183a3313e658e6c6379` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.193801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0442fc6d2b4183a3313e658e6c6379)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:44.195984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:44.273904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0442fc6d2b4183a3313e658e6c6379', 'request_id': 'req-a76c5dae-077a-4202-ac32-a73500331ef5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:44.284190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0442fc6d2b4183a3313e658e6c6379', 'request_id': 'req-a76c5dae-077a-4202-ac32-a73500331ef5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:44.290737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0442fc6d2b4183a3313e658e6c6379', 'request_id': 'req-a76c5dae-077a-4202-ac32-a73500331ef5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:44.308552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] The token cache is being invalidate because project 2c0442fc6d2b4183a3313e658e6c6379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:44.308906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:44.320265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a76c5dae-077a-4202-ac32-a73500331ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:44.324706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 832/1653] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:44 2022] DELETE /identity/v3/projects/2c0442fc6d2b4183a3313e658e6c6379 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:44.330136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8decdd2-f6b3-4eae-8992-4bfca91b1187 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.330424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8decdd2-f6b3-4eae-8992-4bfca91b1187 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.330740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8decdd2-f6b3-4eae-8992-4bfca91b1187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.389931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e8decdd2-f6b3-4eae-8992-4bfca91b1187 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:44.392852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e8decdd2-f6b3-4eae-8992-4bfca91b1187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:44.530045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 822/1654] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:44.538722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6636-773f-4a07-8647-b7090906aff1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.538722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6636-773f-4a07-8647-b7090906aff1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.538722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6636-773f-4a07-8647-b7090906aff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.562091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8decdd2-f6b3-4eae-8992-4bfca91b1187 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:44.563857 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e8decdd2-f6b3-4eae-8992-4bfca91b1187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:44.568644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-68ce6636-773f-4a07-8647-b7090906aff1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:44.571298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-68ce6636-773f-4a07-8647-b7090906aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:44.586556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 833/1655] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:44.591749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce6636-773f-4a07-8647-b7090906aff1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:44.607035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce6636-773f-4a07-8647-b7090906aff1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:44.612173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:44.612913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:44.613360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.613646 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.613927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.614717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:44.615116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:44.617537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:44.635564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 834/1656] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:44.636857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:44.649181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5da2e-f5de-4249-a189-8af814ebc8fe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:44.654183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259561e-011d-4466-b119-0f9a14583d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:44.654962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259561e-011d-4466-b119-0f9a14583d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.655242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259561e-011d-4466-b119-0f9a14583d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.655524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259561e-011d-4466-b119-0f9a14583d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.655794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8decdd2-f6b3-4eae-8992-4bfca91b1187 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:44.656168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259561e-011d-4466-b119-0f9a14583d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:44.658253 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259561e-011d-4466-b119-0f9a14583d14 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:44.660692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:44.661536 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.662002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.662481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.664780 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:44.701103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 835/1657] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:44 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:59:44.703025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259561e-011d-4466-b119-0f9a14583d14 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:44.758969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:44.760499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:44.774021 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 823/1658] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:44.808917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259561e-011d-4466-b119-0f9a14583d14 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:44.814593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f97a7-b1ed-4eb6-8366-e6e5cfb0a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:44.815538 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f97a7-b1ed-4eb6-8366-e6e5cfb0a6ac admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.816018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f97a7-b1ed-4eb6-8366-e6e5cfb0a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.816476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f97a7-b1ed-4eb6-8366-e6e5cfb0a6ac admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.817312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f97a7-b1ed-4eb6-8366-e6e5cfb0a6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:44.819670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f97a7-b1ed-4eb6-8366-e6e5cfb0a6ac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:44.850903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 836/1659] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:44 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:44.855228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:44.885637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec49f10-1062-4a9e-9373-a83dbd356061 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:44.902207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669890f3-ccac-4c3f-9230-1cdc083e3eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:44.903835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669890f3-ccac-4c3f-9230-1cdc083e3eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.904106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669890f3-ccac-4c3f-9230-1cdc083e3eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.904450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669890f3-ccac-4c3f-9230-1cdc083e3eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.905170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669890f3-ccac-4c3f-9230-1cdc083e3eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:44.907259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669890f3-ccac-4c3f-9230-1cdc083e3eb1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:44.920405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 824/1660] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:44.924920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f97a7-b1ed-4eb6-8366-e6e5cfb0a6ac admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:44.952464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f97a7-b1ed-4eb6-8366-e6e5cfb0a6ac admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:44.959027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b07d5-e830-4fe9-9145-ede0a55a9ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:44.960428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b07d5-e830-4fe9-9145-ede0a55a9ded admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:44.960942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b07d5-e830-4fe9-9145-ede0a55a9ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:44.961359 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b07d5-e830-4fe9-9145-ede0a55a9ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:44.962154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b07d5-e830-4fe9-9145-ede0a55a9ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:44.964331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b07d5-e830-4fe9-9145-ede0a55a9ded admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:44.985337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 837/1661] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:44.987801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669890f3-ccac-4c3f-9230-1cdc083e3eb1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:45.001205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669890f3-ccac-4c3f-9230-1cdc083e3eb1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:45.006197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:45.007005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:45.007301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:45.007578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] PATH_INFO: `/v3/projects/dff5cb27b65243ceab44a01eaeb73c29/users/9b8b458d73a440d5b3f74d94e037d2c6/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:45.026789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff5cb27b65243ceab44a01eaeb73c29, user_id=9b8b458d73a440d5b3f74d94e037d2c6, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:45.030653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:45.046905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 825/1662] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:44 2022] PUT /identity/v3/projects/dff5cb27b65243ceab44a01eaeb73c29/users/9b8b458d73a440d5b3f74d94e037d2c6/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:45.058337 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458a39-36ce-48a9-8aa5-83cd18e19ab8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:45.058748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458a39-36ce-48a9-8aa5-83cd18e19ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:45.058978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458a39-36ce-48a9-8aa5-83cd18e19ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:45.092348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d1458a39-36ce-48a9-8aa5-83cd18e19ab8 None None] MFA Rules not processed for user `9b8b458d73a440d5b3f74d94e037d2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:45.093722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d1458a39-36ce-48a9-8aa5-83cd18e19ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:45.103407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:45.181622 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 838/1663] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:45.197353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:45.199244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:45.302824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b30a6-3ddc-4d6a-9dfa-3356920a4219 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:45.308577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ede14ff816494505b20faba615bc5026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:45.309309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:45.309916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:45.310285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:45.320723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:45.322292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:45.333840 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 826/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:46.004501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458a39-36ce-48a9-8aa5-83cd18e19ab8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:46.105114 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458a39-36ce-48a9-8aa5-83cd18e19ab8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:46.109617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f937c-e6ce-4527-89b5-147dc7357fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:46.110225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f937c-e6ce-4527-89b5-147dc7357fba service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:46.110504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f937c-e6ce-4527-89b5-147dc7357fba service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:46.110800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f937c-e6ce-4527-89b5-147dc7357fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:46.112552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b78f937c-e6ce-4527-89b5-147dc7357fba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:46.201797 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f937c-e6ce-4527-89b5-147dc7357fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:46.202908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f937c-e6ce-4527-89b5-147dc7357fba service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:46.230738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 839/1665] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:50.031713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:50.034761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:50.129762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:50.191125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c357c02-187c-4589-8868-d0b4555899e8 service glance] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:50.196890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:50.197646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:50.198004 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:50.198352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] PATH_INFO: `/v3/users/3f742cdac49348efa010f7148d1d4de0` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:50.199605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f742cdac49348efa010f7148d1d4de0)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:50.201684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:50.250798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f742cdac49348efa010f7148d1d4de0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:50.266345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f742cdac49348efa010f7148d1d4de0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:50.274425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f742cdac49348efa010f7148d1d4de0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:50.275564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f742cdac49348efa010f7148d1d4de0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:50.285084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f742cdac49348efa010f7148d1d4de0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:50.293235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 827/1666] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:50 2022] DELETE /identity/v3/users/3f742cdac49348efa010f7148d1d4de0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:50.298437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f835c-d4f2-4e73-9019-a7859142a8b0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:50.299027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f835c-d4f2-4e73-9019-a7859142a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:50.299027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f835c-d4f2-4e73-9019-a7859142a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:50.323655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c70f835c-d4f2-4e73-9019-a7859142a8b0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:50.325006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c70f835c-d4f2-4e73-9019-a7859142a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:50.396968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:50.409102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 840/1667] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:50.420529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:50.423634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:50.511380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c7b73-7798-4146-8831-9f355dce2f12 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:50.516956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:50.517939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:50.518581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:50.519181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:50.534739 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:50.537823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:50.585033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 828/1668] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:50.978824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f835c-d4f2-4e73-9019-a7859142a8b0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:50.980232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c70f835c-d4f2-4e73-9019-a7859142a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.000941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f835c-d4f2-4e73-9019-a7859142a8b0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:51.016249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:51.016914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:51.017191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:51.017460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] PATH_INFO: `/v3/users/314bfc886ac7438ea2e2735f22fc33c9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:51.019219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=314bfc886ac7438ea2e2735f22fc33c9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:51.021339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:51.026360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:51.029046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.054314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e9ed8-d355-4169-948e-9b9b71ad32cf service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:51.063073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:51.064219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:51.064787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:51.065242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] PATH_INFO: `/v3/users/bf254b4eefa34b9ea9e08a37595fc91d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:51.067376 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf254b4eefa34b9ea9e08a37595fc91d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:51.069973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:51.129749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314bfc886ac7438ea2e2735f22fc33c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.130876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314bfc886ac7438ea2e2735f22fc33c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.141434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:51.147881 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314bfc886ac7438ea2e2735f22fc33c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.149040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf254b4eefa34b9ea9e08a37595fc91d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.174160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf254b4eefa34b9ea9e08a37595fc91d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.183311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf254b4eefa34b9ea9e08a37595fc91d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.184321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf254b4eefa34b9ea9e08a37595fc91d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.198084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf254b4eefa34b9ea9e08a37595fc91d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.199149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314bfc886ac7438ea2e2735f22fc33c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.201242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3d90fc60-d860-4862-83c1-dc5a93118c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314bfc886ac7438ea2e2735f22fc33c9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.207910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 829/1669] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:51 2022] DELETE /identity/v3/users/bf254b4eefa34b9ea9e08a37595fc91d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:51.211580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:51.213770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.227027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 841/1670] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:50 2022] DELETE /identity/v3/users/314bfc886ac7438ea2e2735f22fc33c9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:51.228712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75c54-642d-443c-a08a-c91703de34de None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:51.229045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75c54-642d-443c-a08a-c91703de34de None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:51.229320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75c54-642d-443c-a08a-c91703de34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:51.256930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8dd75c54-642d-443c-a08a-c91703de34de None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:51.258456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8dd75c54-642d-443c-a08a-c91703de34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.314535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79a3cb-bad4-4031-8b48-3013efc171a8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:51.334942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 842/1671] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:51.337071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d70c-6bda-4974-9df0-abd2f559b0e4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:51.337560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d70c-6bda-4974-9df0-abd2f559b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:51.338035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d70c-6bda-4974-9df0-abd2f559b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:51.360364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-64c6d70c-6bda-4974-9df0-abd2f559b0e4 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:51.361932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-64c6d70c-6bda-4974-9df0-abd2f559b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.370775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 843/1672] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:51.372493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6d70c-6bda-4974-9df0-abd2f559b0e4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:51.374097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-64c6d70c-6bda-4974-9df0-abd2f559b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.392441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:51.393080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:51.393354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:51.393621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] PATH_INFO: `/v3/projects/fc8aceb0732f4084b1b619e8d30a4307` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:51.394787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8aceb0732f4084b1b619e8d30a4307)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:51.397831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:51.448300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6d70c-6bda-4974-9df0-abd2f559b0e4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:51.462392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8aceb0732f4084b1b619e8d30a4307', 'request_id': 'req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.470365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8aceb0732f4084b1b619e8d30a4307', 'request_id': 'req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.477852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8aceb0732f4084b1b619e8d30a4307', 'request_id': 'req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.483254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:51.486872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:51.504011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] The token cache is being invalidate because project fc8aceb0732f4084b1b619e8d30a4307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:51.504464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.505268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.508058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 830/1673] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:51 2022] DELETE /identity/v3/projects/fc8aceb0732f4084b1b619e8d30a4307 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:51.510129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:51.513602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.539403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:51.540033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:51.540315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:51.540594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:51.542345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.618148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6f58b-c0de-401c-ad64-cca0d8a4581c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:51.626285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:51.627168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:51.627727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:51.627820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:51.627820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:51.629190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:51.629585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.642475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 844/1674] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:51.644463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:51.645389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:51.646130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:51.647038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:51.659784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d086ba8-7d76-4c3c-9731-a050e1080c64 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:51.661969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 831/1675] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:51.666487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:51.667486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:51.667838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:51.668228 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] PATH_INFO: `/v3/users/03a97a0f262d4e55a417cbf4a44fd699` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:51.670643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a97a0f262d4e55a417cbf4a44fd699)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:51.672790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:51.747373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a97a0f262d4e55a417cbf4a44fd699'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.748548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a97a0f262d4e55a417cbf4a44fd699'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.759633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a97a0f262d4e55a417cbf4a44fd699'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.785921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a97a0f262d4e55a417cbf4a44fd699'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.798375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a97a0f262d4e55a417cbf4a44fd699'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:51.834832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 845/1676] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:51 2022] DELETE /identity/v3/users/03a97a0f262d4e55a417cbf4a44fd699 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:52.297832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:52.299750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:52.322295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800f662-5d96-4881-92b9-a0475d3d35e7 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:52.388228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:52.389662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:52.389662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:52.389662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] PATH_INFO: `/v3/projects/39fbd711919e4661a7dcd45bf2329070` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:52.391895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fbd711919e4661a7dcd45bf2329070)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:52.394075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:52.454747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:52.489255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fbd711919e4661a7dcd45bf2329070', 'request_id': 'req-49f28fc5-147c-4bc4-9725-682269071739'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.497408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fbd711919e4661a7dcd45bf2329070', 'request_id': 'req-49f28fc5-147c-4bc4-9725-682269071739'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.498849 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:52.516164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fbd711919e4661a7dcd45bf2329070', 'request_id': 'req-49f28fc5-147c-4bc4-9725-682269071739'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.519340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441ce8c-acbd-4091-8f3f-ff1d96548e90 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:52.533818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] The token cache is being invalidate because project 39fbd711919e4661a7dcd45bf2329070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:52.534118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.535175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.537131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 832/1677] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:52 2022] DELETE /identity/v3/projects/39fbd711919e4661a7dcd45bf2329070 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:52.537922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:52.539412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:52.581712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:52.589969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:52.615196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:52.615991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:52.616589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:52.616775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] PATH_INFO: `/v3/projects/cee1bb1cd57d4a359b443472cc0869a4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:52.618347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee1bb1cd57d4a359b443472cc0869a4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:52.620584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:52.639554 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f28fc5-147c-4bc4-9725-682269071739 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:52.645411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:52.646276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:52.647058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:52.647058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] PATH_INFO: `/v3/projects/4d7466149ff6445f994066a66b5dc3c7` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:52.649383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7466149ff6445f994066a66b5dc3c7)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:52.651901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:52.675536 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee1bb1cd57d4a359b443472cc0869a4', 'request_id': 'req-fde2222a-084d-4250-9856-5b408565e1e9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.683325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee1bb1cd57d4a359b443472cc0869a4', 'request_id': 'req-fde2222a-084d-4250-9856-5b408565e1e9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.691745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee1bb1cd57d4a359b443472cc0869a4', 'request_id': 'req-fde2222a-084d-4250-9856-5b408565e1e9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.707905 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] The token cache is being invalidate because project cee1bb1cd57d4a359b443472cc0869a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:52.708412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.709715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.711222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7466149ff6445f994066a66b5dc3c7', 'request_id': 'req-7e36595b-106b-4752-b8cd-751951286de8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.715691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 846/1678] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:52 2022] DELETE /identity/v3/projects/cee1bb1cd57d4a359b443472cc0869a4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:52.719268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:52.721007 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7466149ff6445f994066a66b5dc3c7', 'request_id': 'req-7e36595b-106b-4752-b8cd-751951286de8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.721411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:52.732469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7466149ff6445f994066a66b5dc3c7', 'request_id': 'req-7e36595b-106b-4752-b8cd-751951286de8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.751184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] The token cache is being invalidate because project 4d7466149ff6445f994066a66b5dc3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:52.751758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.752557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.755676 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 833/1679] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:52 2022] DELETE /identity/v3/projects/4d7466149ff6445f994066a66b5dc3c7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:52.756687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:52.758109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:52.796959 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2222a-084d-4250-9856-5b408565e1e9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:52.830532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36595b-106b-4752-b8cd-751951286de8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:52.835398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:52.836111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:52.836466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:52.836816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] PATH_INFO: `/v3/users/9dc7aa3f83a54c6ab738fed38ab124fd` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:52.837968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc7aa3f83a54c6ab738fed38ab124fd)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:52.839931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:52.865973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:52.866641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:52.867070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:52.867301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] PATH_INFO: `/v3/users/a2e4666b5e414325a9727ff6b44af19a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:52.868716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e4666b5e414325a9727ff6b44af19a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:52.870668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:52.889330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc7aa3f83a54c6ab738fed38ab124fd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.897513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:52.903551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:52.906420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc7aa3f83a54c6ab738fed38ab124fd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.915303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc7aa3f83a54c6ab738fed38ab124fd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.916206 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc7aa3f83a54c6ab738fed38ab124fd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.924161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16757a5e-75dc-419b-a37d-67918ad58b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc7aa3f83a54c6ab738fed38ab124fd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.924816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e4666b5e414325a9727ff6b44af19a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.925475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e4666b5e414325a9727ff6b44af19a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.930424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 834/1680] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:52 2022] DELETE /identity/v3/users/9dc7aa3f83a54c6ab738fed38ab124fd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:52.931659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b1548-2495-4ada-9814-33958c0fd836 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:52.931941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b1548-2495-4ada-9814-33958c0fd836 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:52.932215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b1548-2495-4ada-9814-33958c0fd836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:52.933125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e4666b5e414325a9727ff6b44af19a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.947728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e4666b5e414325a9727ff6b44af19a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.948478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2d20f33f-60a0-461d-a03b-a680d9107dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e4666b5e414325a9727ff6b44af19a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:52.954482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-541b1548-2495-4ada-9814-33958c0fd836 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:52.956210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-541b1548-2495-4ada-9814-33958c0fd836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:52.966198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 847/1681] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:52 2022] DELETE /identity/v3/users/a2e4666b5e414325a9727ff6b44af19a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:53.044667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 835/1682] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:53.045972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7370-74a5-44f1-88b0-ec2f3ff99a9b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.046303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7370-74a5-44f1-88b0-ec2f3ff99a9b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.047039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7370-74a5-44f1-88b0-ec2f3ff99a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.076075 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-190c7370-74a5-44f1-88b0-ec2f3ff99a9b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:53.078056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-190c7370-74a5-44f1-88b0-ec2f3ff99a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.186250 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 848/1683] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:53.191482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b1548-2495-4ada-9814-33958c0fd836 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.204611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b1548-2495-4ada-9814-33958c0fd836 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.210770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.211667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.212142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.212569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.213440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:53.213935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.216407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.231857 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 836/1684] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:53.235928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7370-74a5-44f1-88b0-ec2f3ff99a9b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.245791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7370-74a5-44f1-88b0-ec2f3ff99a9b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.251099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.251712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.251995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.252271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.252929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.254895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.286970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 849/1685] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:53 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:53.291214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.309710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ceb51-ce00-4326-8139-a50194c5a93b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.330831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.332717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.421421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.422057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.422416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.422781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.423611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.428098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.428204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6294f3-f52f-4839-8df4-a5a5af2f38fe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.432973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.433641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.434486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.434818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] PATH_INFO: `/v3/projects/4eb7d5b4204e4dab8b5ce8cd6d064c34` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.435943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb7d5b4204e4dab8b5ce8cd6d064c34)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.437892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.458803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 837/1686] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:53 2022] POST /identity/v3/users => generated 280 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:59:53.459440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.460996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.471506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:53.473211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a232-a6e6-4015-a141-000300387655 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.478379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.479025 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.479302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.479572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] PATH_INFO: `/v3/projects/648b00709bff4c72963a3901b31f3c1e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.480870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] RBAC: Authorizing `identity:delete_project(project_id=648b00709bff4c72963a3901b31f3c1e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.482884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.498446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb7d5b4204e4dab8b5ce8cd6d064c34', 'request_id': 'req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.505785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb7d5b4204e4dab8b5ce8cd6d064c34', 'request_id': 'req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.512785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb7d5b4204e4dab8b5ce8cd6d064c34', 'request_id': 'req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.530430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] The token cache is being invalidate because project 4eb7d5b4204e4dab8b5ce8cd6d064c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:53.530973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.531650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.534078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 850/1687] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:53 2022] DELETE /identity/v3/projects/4eb7d5b4204e4dab8b5ce8cd6d064c34 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:53.534871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.536226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648b00709bff4c72963a3901b31f3c1e', 'request_id': 'req-1a1fe1b5-c601-4458-bb88-9ce689ed066e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.536357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.537558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:53.546408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648b00709bff4c72963a3901b31f3c1e', 'request_id': 'req-1a1fe1b5-c601-4458-bb88-9ce689ed066e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.555641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648b00709bff4c72963a3901b31f3c1e', 'request_id': 'req-1a1fe1b5-c601-4458-bb88-9ce689ed066e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.571430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] The token cache is being invalidate because project 648b00709bff4c72963a3901b31f3c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:53.571940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.572848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.575624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 838/1688] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:53 2022] DELETE /identity/v3/projects/648b00709bff4c72963a3901b31f3c1e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:53.577131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.580028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.625296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef888c-a6dd-4e73-bfb7-b543a73a5a00 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.655705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fe1b5-c601-4458-bb88-9ce689ed066e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.661116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.661767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.662046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.662320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] PATH_INFO: `/v3/users/528dc3d702054274a6591e42e664488a` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.664354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528dc3d702054274a6591e42e664488a)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.665652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.696749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709ab44-399f-4255-9350-5cdc0536e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.697453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ab44-399f-4255-9350-5cdc0536e882 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.697942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ab44-399f-4255-9350-5cdc0536e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.699046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ab44-399f-4255-9350-5cdc0536e882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.699046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709ab44-399f-4255-9350-5cdc0536e882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.700797 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709ab44-399f-4255-9350-5cdc0536e882 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.715017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 851/1689] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:53.715017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db6b2-31a8-441a-8212-ce450a3fca62 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.715017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db6b2-31a8-441a-8212-ce450a3fca62 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.715017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db6b2-31a8-441a-8212-ce450a3fca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.732668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528dc3d702054274a6591e42e664488a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.735396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-874db6b2-31a8-441a-8212-ce450a3fca62 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:53.736606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-874db6b2-31a8-441a-8212-ce450a3fca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.744761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 852/1690] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:53.745527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db6b2-31a8-441a-8212-ce450a3fca62 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.747582 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528dc3d702054274a6591e42e664488a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.747941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-874db6b2-31a8-441a-8212-ce450a3fca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.755439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528dc3d702054274a6591e42e664488a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.756566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528dc3d702054274a6591e42e664488a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.759520 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db6b2-31a8-441a-8212-ce450a3fca62 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.765425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a365e308-f7fb-46b7-a6fe-ba683e46b6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528dc3d702054274a6591e42e664488a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:53.765825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.766414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.766744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.767002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.767652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.769251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.772514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 839/1691] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:53 2022] DELETE /identity/v3/users/528dc3d702054274a6591e42e664488a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:53.773768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9534c-ee4b-4bfd-b5ee-7774a03f33d5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.774127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9534c-ee4b-4bfd-b5ee-7774a03f33d5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.774469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9534c-ee4b-4bfd-b5ee-7774a03f33d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.784639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 853/1692] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:53.788414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.790269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.800211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e7b9534c-ee4b-4bfd-b5ee-7774a03f33d5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:53.801426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e7b9534c-ee4b-4bfd-b5ee-7774a03f33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:53.805883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53094-0045-4255-9af8-f3332b975bdd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.851886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:53.870737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:53.894598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0bddc-4b5e-4e81-b91c-8dd54d85ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.894598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0bddc-4b5e-4e81-b91c-8dd54d85ec9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.894598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0bddc-4b5e-4e81-b91c-8dd54d85ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.894598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0bddc-4b5e-4e81-b91c-8dd54d85ec9b admin admin] PATH_INFO: `/v3/projects/57c4546478d94da0b85519378443be96/users/fb24f1a13f3649898659dd6d7165a894/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.896477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 840/1693] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:53.900864 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9534c-ee4b-4bfd-b5ee-7774a03f33d5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.910829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9534c-ee4b-4bfd-b5ee-7774a03f33d5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.913302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0bddc-4b5e-4e81-b91c-8dd54d85ec9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c4546478d94da0b85519378443be96, user_id=fb24f1a13f3649898659dd6d7165a894, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.915908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:53.916561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.916839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.916942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0bddc-4b5e-4e81-b91c-8dd54d85ec9b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.917134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.918202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:53.918202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:53.920391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:53.935234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 841/1694] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:53.939841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:53.947919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 854/1695] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:53 2022] PUT /identity/v3/projects/57c4546478d94da0b85519378443be96/users/fb24f1a13f3649898659dd6d7165a894/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:53.951389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41d8f9-ab22-470f-af23-c83eba475c6c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:53.959357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875135c0-7359-42c5-85af-4f95a0f4cc9f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:53.959883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875135c0-7359-42c5-85af-4f95a0f4cc9f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:53.960211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875135c0-7359-42c5-85af-4f95a0f4cc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:53.991247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-875135c0-7359-42c5-85af-4f95a0f4cc9f None None] MFA Rules not processed for user `fb24f1a13f3649898659dd6d7165a894`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:53.992513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-875135c0-7359-42c5-85af-4f95a0f4cc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.020877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c33d2-4344-4c76-9d08-7578e174a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.021634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c33d2-4344-4c76-9d08-7578e174a989 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.021940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c33d2-4344-4c76-9d08-7578e174a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.022282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c33d2-4344-4c76-9d08-7578e174a989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.023068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c33d2-4344-4c76-9d08-7578e174a989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.025178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c33d2-4344-4c76-9d08-7578e174a989 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.062555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 842/1696] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:53 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:59:54.064098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c33d2-4344-4c76-9d08-7578e174a989 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.070585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 855/1697] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:54.111257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875135c0-7359-42c5-85af-4f95a0f4cc9f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.112760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-875135c0-7359-42c5-85af-4f95a0f4cc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.156837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c33d2-4344-4c76-9d08-7578e174a989 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.161915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.162695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.163332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.163704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.164457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.166483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.188092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875135c0-7359-42c5-85af-4f95a0f4cc9f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.192136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 843/1698] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:59:54.192136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.192136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.204038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3213da2-019f-4c93-9475-15b477881e1d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.208636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.209243 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.209520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.209783 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] PATH_INFO: `/v3/projects/d360cb9910cf4846acf627c96474e9a3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.210936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d360cb9910cf4846acf627c96474e9a3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.212818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.244826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699caa5-e1ee-433e-8fe3-f65293ac770e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.245361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699caa5-e1ee-433e-8fe3-f65293ac770e service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.245635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699caa5-e1ee-433e-8fe3-f65293ac770e service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.245905 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699caa5-e1ee-433e-8fe3-f65293ac770e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.260081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd360cb9910cf4846acf627c96474e9a3', 'request_id': 'req-d7109130-a435-4105-bb4d-c2d310922c18'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.264843 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:54.268278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd360cb9910cf4846acf627c96474e9a3', 'request_id': 'req-d7109130-a435-4105-bb4d-c2d310922c18'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.269565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:54.275511 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd360cb9910cf4846acf627c96474e9a3', 'request_id': 'req-d7109130-a435-4105-bb4d-c2d310922c18'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.289849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] The token cache is being invalidate because project d360cb9910cf4846acf627c96474e9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:54.290231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.290922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.292412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 844/1699] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:54 2022] DELETE /identity/v3/projects/d360cb9910cf4846acf627c96474e9a3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:54.296540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.296540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.309827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699caa5-e1ee-433e-8fe3-f65293ac770e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.311369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699caa5-e1ee-433e-8fe3-f65293ac770e service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.322727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 856/1700] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:54.324089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1993-384c-43ee-9897-532c6de785af None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.324972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1993-384c-43ee-9897-532c6de785af None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.325265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1993-384c-43ee-9897-532c6de785af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.346793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f97b1993-384c-43ee-9897-532c6de785af None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:54.348737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f97b1993-384c-43ee-9897-532c6de785af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.374016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7109130-a435-4105-bb4d-c2d310922c18 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.379077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.379792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.380166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.380979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.383059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.384717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.396567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 845/1701] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:54.397403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.399173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.413971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd1dd-01c9-410c-937f-496314ea5d8c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.414217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 857/1702] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:54.415311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b1993-384c-43ee-9897-532c6de785af None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.422442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.423246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.423626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.424812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] PATH_INFO: `/v3/users/fb24f1a13f3649898659dd6d7165a894` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.426296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb24f1a13f3649898659dd6d7165a894)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.426885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b1993-384c-43ee-9897-532c6de785af None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.428271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.432221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f00e7-ff57-416f-8718-ba0f9f6ad18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.432999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f00e7-ff57-416f-8718-ba0f9f6ad18e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.433447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f00e7-ff57-416f-8718-ba0f9f6ad18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.434676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f00e7-ff57-416f-8718-ba0f9f6ad18e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.435478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f00e7-ff57-416f-8718-ba0f9f6ad18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.438061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f00e7-ff57-416f-8718-ba0f9f6ad18e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.455289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 858/1703] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:54.455289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d5054-291c-4cb8-ac6c-e70bfbe1e4e3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.455289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d5054-291c-4cb8-ac6c-e70bfbe1e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.455289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d5054-291c-4cb8-ac6c-e70bfbe1e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.475194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-255d5054-291c-4cb8-ac6c-e70bfbe1e4e3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:54.476492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-255d5054-291c-4cb8-ac6c-e70bfbe1e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.488057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb24f1a13f3649898659dd6d7165a894'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.488729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 859/1704] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:54.489501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d5054-291c-4cb8-ac6c-e70bfbe1e4e3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.500303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d5054-291c-4cb8-ac6c-e70bfbe1e4e3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.502830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb24f1a13f3649898659dd6d7165a894'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.505064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96452-bdcb-401b-b45c-ff29d4e6ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.505712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96452-bdcb-401b-b45c-ff29d4e6ba8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.505989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96452-bdcb-401b-b45c-ff29d4e6ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.506376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96452-bdcb-401b-b45c-ff29d4e6ba8f admin admin] PATH_INFO: `/v3/projects/6901e78d5fa342089ecd0b5747282880/users/554064e153e64426b6eb1a509cd77b96/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.511095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb24f1a13f3649898659dd6d7165a894'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.511679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb24f1a13f3649898659dd6d7165a894'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.521182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb24f1a13f3649898659dd6d7165a894'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:54.525319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb96452-bdcb-401b-b45c-ff29d4e6ba8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6901e78d5fa342089ecd0b5747282880, user_id=554064e153e64426b6eb1a509cd77b96, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.528494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 846/1705] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:54 2022] DELETE /identity/v3/users/fb24f1a13f3649898659dd6d7165a894 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:54.528803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb96452-bdcb-401b-b45c-ff29d4e6ba8f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.531819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.533752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.548149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 860/1706] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:54 2022] PUT /identity/v3/projects/6901e78d5fa342089ecd0b5747282880/users/554064e153e64426b6eb1a509cd77b96/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:54.548149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a29b7-0a1f-4e16-b2e1-6fe281409b8d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.557425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a29b7-0a1f-4e16-b2e1-6fe281409b8d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.557425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a29b7-0a1f-4e16-b2e1-6fe281409b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.592427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f80a29b7-0a1f-4e16-b2e1-6fe281409b8d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:54.593659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f80a29b7-0a1f-4e16-b2e1-6fe281409b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.601110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:54.616321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b250dcf-aa53-48ee-bf19-f56781c501f1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.657219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 861/1707] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:54.658543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682dc49-4154-444c-96b3-cd176e8493db None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.658842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682dc49-4154-444c-96b3-cd176e8493db None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.659120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682dc49-4154-444c-96b3-cd176e8493db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.676122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.676777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.677051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.677321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.677964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:54.678265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.679880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.690306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0682dc49-4154-444c-96b3-cd176e8493db None None] MFA Rules not processed for user `554064e153e64426b6eb1a509cd77b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:54.691574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0682dc49-4154-444c-96b3-cd176e8493db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.692291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 847/1708] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 16:59:54.695421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.697374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:54.698165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.765977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d3b4c-e0e1-4e26-99d9-46d0941a9a8d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.769936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba39795-1782-4b0b-9316-cfc691918035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.770713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba39795-1782-4b0b-9316-cfc691918035 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.771199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba39795-1782-4b0b-9316-cfc691918035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.771468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba39795-1782-4b0b-9316-cfc691918035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.784397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba39795-1782-4b0b-9316-cfc691918035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.785908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba39795-1782-4b0b-9316-cfc691918035 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.796375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 848/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:54.800566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba39795-1782-4b0b-9316-cfc691918035 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.800698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 862/1710] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:54.802926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682dc49-4154-444c-96b3-cd176e8493db None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.807577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0682dc49-4154-444c-96b3-cd176e8493db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:54.816928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba39795-1782-4b0b-9316-cfc691918035 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.822342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682dc49-4154-444c-96b3-cd176e8493db None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.822984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25cb83-2c69-4e81-adcd-cb13b558155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.823674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cb83-2c69-4e81-adcd-cb13b558155f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.824028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cb83-2c69-4e81-adcd-cb13b558155f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.824382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cb83-2c69-4e81-adcd-cb13b558155f admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.825733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25cb83-2c69-4e81-adcd-cb13b558155f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.827893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25cb83-2c69-4e81-adcd-cb13b558155f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.828964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea2b01-7f0a-42c2-96b9-3d4b1ac9f199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.829591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2b01-7f0a-42c2-96b9-3d4b1ac9f199 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.829875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2b01-7f0a-42c2-96b9-3d4b1ac9f199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.830152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2b01-7f0a-42c2-96b9-3d4b1ac9f199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.830829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea2b01-7f0a-42c2-96b9-3d4b1ac9f199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.835131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea2b01-7f0a-42c2-96b9-3d4b1ac9f199 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:54.879068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 863/1711] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:54.886364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea2b01-7f0a-42c2-96b9-3d4b1ac9f199 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.891730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 849/1712] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:54.892816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25cb83-2c69-4e81-adcd-cb13b558155f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:54.988362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea2b01-7f0a-42c2-96b9-3d4b1ac9f199 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.994392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25cb83-2c69-4e81-adcd-cb13b558155f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:54.994897 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d856-0f5e-4d8a-ab82-ef8f5ed4f516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:54.995634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d856-0f5e-4d8a-ab82-ef8f5ed4f516 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:54.995985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d856-0f5e-4d8a-ab82-ef8f5ed4f516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:54.996877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d856-0f5e-4d8a-ab82-ef8f5ed4f516 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:54.997605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37d856-0f5e-4d8a-ab82-ef8f5ed4f516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:54.999786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37d856-0f5e-4d8a-ab82-ef8f5ed4f516 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.004537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48057070-60f1-43c5-a881-a50373896799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.005700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48057070-60f1-43c5-a881-a50373896799 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.006424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48057070-60f1-43c5-a881-a50373896799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.006908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48057070-60f1-43c5-a881-a50373896799 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.011385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48057070-60f1-43c5-a881-a50373896799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.016948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48057070-60f1-43c5-a881-a50373896799 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.034564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 864/1713] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:55.037047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d856-0f5e-4d8a-ab82-ef8f5ed4f516 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.050101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d856-0f5e-4d8a-ab82-ef8f5ed4f516 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.056278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 850/1714] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:54 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:55.057465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48057070-60f1-43c5-a881-a50373896799 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.060140 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9251d68-92c2-4368-b58d-dc6fdfe15090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.060949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9251d68-92c2-4368-b58d-dc6fdfe15090 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.061471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9251d68-92c2-4368-b58d-dc6fdfe15090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.061923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9251d68-92c2-4368-b58d-dc6fdfe15090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.062737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9251d68-92c2-4368-b58d-dc6fdfe15090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.063487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:55.065190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9251d68-92c2-4368-b58d-dc6fdfe15090 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.071529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48057070-60f1-43c5-a881-a50373896799 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.078896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 865/1715] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:55.082602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d1ec2-41c0-46a3-b666-24bbc5a78a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.083154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9251d68-92c2-4368-b58d-dc6fdfe15090 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.083258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1ec2-41c0-46a3-b666-24bbc5a78a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.083513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1ec2-41c0-46a3-b666-24bbc5a78a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.084212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1ec2-41c0-46a3-b666-24bbc5a78a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.084501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d1ec2-41c0-46a3-b666-24bbc5a78a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.086555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d1ec2-41c0-46a3-b666-24bbc5a78a6c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.095034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9251d68-92c2-4368-b58d-dc6fdfe15090 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.098893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 851/1716] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:55.102401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d1ec2-41c0-46a3-b666-24bbc5a78a6c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.103770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685acdd4-60a2-4bf4-b0f8-d9d035f8ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.104561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685acdd4-60a2-4bf4-b0f8-d9d035f8ba4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.105055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685acdd4-60a2-4bf4-b0f8-d9d035f8ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.106201 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685acdd4-60a2-4bf4-b0f8-d9d035f8ba4b admin admin] PATH_INFO: `/v3/projects/085e046fd90040cbafb833fc08618a0d/users/e0030d3d72e542afbcb01732904cf7bc/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.115604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d1ec2-41c0-46a3-b666-24bbc5a78a6c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.146732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685acdd4-60a2-4bf4-b0f8-d9d035f8ba4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=085e046fd90040cbafb833fc08618a0d, user_id=e0030d3d72e542afbcb01732904cf7bc, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.146732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685acdd4-60a2-4bf4-b0f8-d9d035f8ba4b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.154008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5052-23e3-4b04-9373-466e66530e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.155158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5052-23e3-4b04-9373-466e66530e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.155421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5052-23e3-4b04-9373-466e66530e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.156614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5052-23e3-4b04-9373-466e66530e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.156614 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf5052-23e3-4b04-9373-466e66530e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.158618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf5052-23e3-4b04-9373-466e66530e77 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.172873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 852/1717] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:55.177626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5052-23e3-4b04-9373-466e66530e77 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.178822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 866/1718] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:55 2022] PUT /identity/v3/projects/085e046fd90040cbafb833fc08618a0d/users/e0030d3d72e542afbcb01732904cf7bc/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:55.185580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685acdd4-60a2-4bf4-b0f8-d9d035f8ba4b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.196248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf5052-23e3-4b04-9373-466e66530e77 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.255092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:55.282056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685acdd4-60a2-4bf4-b0f8-d9d035f8ba4b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.287569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dd564-e8ed-406b-bdb3-c2acd2ef780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.288711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dd564-e8ed-406b-bdb3-c2acd2ef780f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.289086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dd564-e8ed-406b-bdb3-c2acd2ef780f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.289438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dd564-e8ed-406b-bdb3-c2acd2ef780f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.290366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dd564-e8ed-406b-bdb3-c2acd2ef780f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.291138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdca88-d0d4-47cb-a22b-8c448b99515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.291946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdca88-d0d4-47cb-a22b-8c448b99515a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.292175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dd564-e8ed-406b-bdb3-c2acd2ef780f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.292278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdca88-d0d4-47cb-a22b-8c448b99515a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.292490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdca88-d0d4-47cb-a22b-8c448b99515a admin admin] PATH_INFO: `/v3/projects/fec8c13240b644798d00dc7de3d3169b/users/7106814831964de18a0fc834e68ff0bc/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.304981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 867/1719] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:55.310500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dd564-e8ed-406b-bdb3-c2acd2ef780f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.320477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdca88-d0d4-47cb-a22b-8c448b99515a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec8c13240b644798d00dc7de3d3169b, user_id=7106814831964de18a0fc834e68ff0bc, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.325826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdca88-d0d4-47cb-a22b-8c448b99515a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.326112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dd564-e8ed-406b-bdb3-c2acd2ef780f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.332948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.336181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.336181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.336181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] PATH_INFO: `/v3/projects/085e046fd90040cbafb833fc08618a0d/users/e0030d3d72e542afbcb01732904cf7bc/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.354103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 853/1720] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:55 2022] PUT /identity/v3/projects/fec8c13240b644798d00dc7de3d3169b/users/7106814831964de18a0fc834e68ff0bc/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:55.358247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085e046fd90040cbafb833fc08618a0d, user_id=e0030d3d72e542afbcb01732904cf7bc, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.364441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.366054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708d75a-d241-420c-bb09-03009d420a68 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.366339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708d75a-d241-420c-bb09-03009d420a68 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.366640 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708d75a-d241-420c-bb09-03009d420a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.383464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 868/1721] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:55 2022] PUT /identity/v3/projects/085e046fd90040cbafb833fc08618a0d/users/e0030d3d72e542afbcb01732904cf7bc/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:55.395059 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.397342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:55.401853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0708d75a-d241-420c-bb09-03009d420a68 None None] MFA Rules not processed for user `7106814831964de18a0fc834e68ff0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:55.403267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0708d75a-d241-420c-bb09-03009d420a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:55.499941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 854/1722] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:55.502448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ddf58-4186-4168-b533-05171beed821 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.503024 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ddf58-4186-4168-b533-05171beed821 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.503447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ddf58-4186-4168-b533-05171beed821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.519988 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789324-7ee2-4976-aaad-f52f2e0d21f9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.535683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.536349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.536625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.536897 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] PATH_INFO: `/v3/projects/57c4546478d94da0b85519378443be96` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.538821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c4546478d94da0b85519378443be96)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.541901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.553759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ef7ddf58-4186-4168-b533-05171beed821 None None] MFA Rules not processed for user `e0030d3d72e542afbcb01732904cf7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:55.555513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ef7ddf58-4186-4168-b533-05171beed821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:55.630649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c4546478d94da0b85519378443be96', 'request_id': 'req-1ce2d694-5af3-421a-9997-117b6ca409cd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:55.647914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c4546478d94da0b85519378443be96', 'request_id': 'req-1ce2d694-5af3-421a-9997-117b6ca409cd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:55.656745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c4546478d94da0b85519378443be96', 'request_id': 'req-1ce2d694-5af3-421a-9997-117b6ca409cd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:55.665335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:55.678674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] The token cache is being invalidate because project 57c4546478d94da0b85519378443be96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:55.679402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:55.681443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:55.684712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 869/1723] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:55 2022] DELETE /identity/v3/projects/57c4546478d94da0b85519378443be96 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:55.685837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.687596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:55.730193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 855/1724] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:55.738820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286355-2bf7-47f5-bb0f-d01fb46c3add None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.739113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286355-2bf7-47f5-bb0f-d01fb46c3add None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.739475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286355-2bf7-47f5-bb0f-d01fb46c3add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.776378 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-87286355-2bf7-47f5-bb0f-d01fb46c3add None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:55.778349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-87286355-2bf7-47f5-bb0f-d01fb46c3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:55.795990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2d694-5af3-421a-9997-117b6ca409cd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.801335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9afdb-2d0f-41fa-b327-b7c7f4fb19a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.802214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9afdb-2d0f-41fa-b327-b7c7f4fb19a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.802427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9afdb-2d0f-41fa-b327-b7c7f4fb19a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.802744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9afdb-2d0f-41fa-b327-b7c7f4fb19a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.804613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-02b9afdb-2d0f-41fa-b327-b7c7f4fb19a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:55.812526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:55.928447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 856/1725] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:55.929384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87286355-2bf7-47f5-bb0f-d01fb46c3add None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.930734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-87286355-2bf7-47f5-bb0f-d01fb46c3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:55.937748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9afdb-2d0f-41fa-b327-b7c7f4fb19a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:55.939297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9afdb-2d0f-41fa-b327-b7c7f4fb19a5 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:55.943836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87286355-2bf7-47f5-bb0f-d01fb46c3add None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:55.947693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2ff2-9dd2-45c6-a086-6b6e7b00114f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:55.948331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2ff2-9dd2-45c6-a086-6b6e7b00114f service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.948611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2ff2-9dd2-45c6-a086-6b6e7b00114f service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.948881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2ff2-9dd2-45c6-a086-6b6e7b00114f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.950897 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 870/1726] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:55.951930 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432f44-3409-4f14-834c-919c0b055872 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:55.952348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432f44-3409-4f14-834c-919c0b055872 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:55.952719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432f44-3409-4f14-834c-919c0b055872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:55.973814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1a432f44-3409-4f14-834c-919c0b055872 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:55.975164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1a432f44-3409-4f14-834c-919c0b055872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:55.984456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 871/1727] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:55.988390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a432f44-3409-4f14-834c-919c0b055872 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:55.998464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a432f44-3409-4f14-834c-919c0b055872 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.004549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.005179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.005633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.005952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.007476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:56.007790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.009650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.026138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 872/1728] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:59:56.033313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.045473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58575993-fa95-43b8-a345-02729106e75b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.046389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe2ff2-9dd2-45c6-a086-6b6e7b00114f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.047956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe2ff2-9dd2-45c6-a086-6b6e7b00114f service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.057887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3154c6-a200-459e-b9cc-0ca2a5fa3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.058467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3154c6-a200-459e-b9cc-0ca2a5fa3bac admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.059045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 857/1729] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:56.059205 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3154c6-a200-459e-b9cc-0ca2a5fa3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.059513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3154c6-a200-459e-b9cc-0ca2a5fa3bac admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.060403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3154c6-a200-459e-b9cc-0ca2a5fa3bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.062572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3154c6-a200-459e-b9cc-0ca2a5fa3bac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.109302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 873/1730] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:56 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:59:56.110657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2ff2-9dd2-45c6-a086-6b6e7b00114f service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.127020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2ff2-9dd2-45c6-a086-6b6e7b00114f service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.201522 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089048d-52fe-44e2-af0e-42da53169786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.202385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089048d-52fe-44e2-af0e-42da53169786 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.202832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089048d-52fe-44e2-af0e-42da53169786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.203270 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089048d-52fe-44e2-af0e-42da53169786 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.204438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089048d-52fe-44e2-af0e-42da53169786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.207137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089048d-52fe-44e2-af0e-42da53169786 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.270054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 858/1731] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:56 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:56.275529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3154c6-a200-459e-b9cc-0ca2a5fa3bac admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.291198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3154c6-a200-459e-b9cc-0ca2a5fa3bac admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.297578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dbad0-0209-45cb-a7c4-7396bb4d3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.298342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dbad0-0209-45cb-a7c4-7396bb4d3f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.298928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dbad0-0209-45cb-a7c4-7396bb4d3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.299318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dbad0-0209-45cb-a7c4-7396bb4d3f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.300112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2dbad0-0209-45cb-a7c4-7396bb4d3f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.301956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2dbad0-0209-45cb-a7c4-7396bb4d3f5f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.317961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 874/1732] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:56.331095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089048d-52fe-44e2-af0e-42da53169786 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.337986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:56.343653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089048d-52fe-44e2-af0e-42da53169786 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.352045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a708293-5400-4c19-bf1a-6e4598007588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.367233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a708293-5400-4c19-bf1a-6e4598007588 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.367233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a708293-5400-4c19-bf1a-6e4598007588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.367233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a708293-5400-4c19-bf1a-6e4598007588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.367233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a708293-5400-4c19-bf1a-6e4598007588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.367233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a708293-5400-4c19-bf1a-6e4598007588 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.381725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dbad0-0209-45cb-a7c4-7396bb4d3f5f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.385264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 859/1733] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:56.390755 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a708293-5400-4c19-bf1a-6e4598007588 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.406616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a708293-5400-4c19-bf1a-6e4598007588 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.416356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888252f6-6d69-41f6-b06a-6f1a3ebf0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.417029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888252f6-6d69-41f6-b06a-6f1a3ebf0529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.417308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888252f6-6d69-41f6-b06a-6f1a3ebf0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.417579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888252f6-6d69-41f6-b06a-6f1a3ebf0529 admin admin] PATH_INFO: `/v3/projects/22dbc775f4114f71bcfde8920ebb9d1e/users/e12ddf9db9704249993457171091c430/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.454542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888252f6-6d69-41f6-b06a-6f1a3ebf0529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22dbc775f4114f71bcfde8920ebb9d1e, user_id=e12ddf9db9704249993457171091c430, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.457421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888252f6-6d69-41f6-b06a-6f1a3ebf0529 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.469923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dbad0-0209-45cb-a7c4-7396bb4d3f5f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.474670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 860/1734] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:56 2022] PUT /identity/v3/projects/22dbc775f4114f71bcfde8920ebb9d1e/users/e12ddf9db9704249993457171091c430/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:56.485983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73c4d-68b9-4652-bc26-f603da71240d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.486296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73c4d-68b9-4652-bc26-f603da71240d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.486553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73c4d-68b9-4652-bc26-f603da71240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.517518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5bd73c4d-68b9-4652-bc26-f603da71240d None None] MFA Rules not processed for user `e12ddf9db9704249993457171091c430`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:56.518778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5bd73c4d-68b9-4652-bc26-f603da71240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:56.531838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.532557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.533067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.533423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.536418 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:56.572346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:56.596014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 861/1735] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:56.606875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd73c4d-68b9-4652-bc26-f603da71240d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.616614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.620820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.632216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 875/1736] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:59:56.682441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd73c4d-68b9-4652-bc26-f603da71240d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.688048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b6327-3201-4c90-80f9-bc5ee6517429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.688845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b6327-3201-4c90-80f9-bc5ee6517429 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.689244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b6327-3201-4c90-80f9-bc5ee6517429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.689638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b6327-3201-4c90-80f9-bc5ee6517429 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.690407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b6327-3201-4c90-80f9-bc5ee6517429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.692813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b6327-3201-4c90-80f9-bc5ee6517429 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.724649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 862/1737] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:56 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 16:59:56.729056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.740210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503662fd-c1c5-448d-ba42-6edc7b082f26 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.814359 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320f8b-1ae4-4b0e-97e7-eba43b586eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.814945 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320f8b-1ae4-4b0e-97e7-eba43b586eca admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.815213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320f8b-1ae4-4b0e-97e7-eba43b586eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.815489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320f8b-1ae4-4b0e-97e7-eba43b586eca admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.816122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac320f8b-1ae4-4b0e-97e7-eba43b586eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.818061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac320f8b-1ae4-4b0e-97e7-eba43b586eca admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.839772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 876/1738] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:56 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:56.843978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b6327-3201-4c90-80f9-bc5ee6517429 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.854048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b6327-3201-4c90-80f9-bc5ee6517429 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.859113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d333784-3e4d-450c-8821-0f9c124abb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.859697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333784-3e4d-450c-8821-0f9c124abb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.859970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333784-3e4d-450c-8821-0f9c124abb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.860238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333784-3e4d-450c-8821-0f9c124abb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.860865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d333784-3e4d-450c-8821-0f9c124abb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.862445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d333784-3e4d-450c-8821-0f9c124abb86 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.873112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 863/1739] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:56.877005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320f8b-1ae4-4b0e-97e7-eba43b586eca admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.886874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320f8b-1ae4-4b0e-97e7-eba43b586eca admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.891675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60641a7-c4dd-414c-b160-c221825091d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.892279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60641a7-c4dd-414c-b160-c221825091d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.892554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60641a7-c4dd-414c-b160-c221825091d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.892829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60641a7-c4dd-414c-b160-c221825091d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.893465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60641a7-c4dd-414c-b160-c221825091d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.895106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60641a7-c4dd-414c-b160-c221825091d4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.905495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 877/1740] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:56.910450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d333784-3e4d-450c-8821-0f9c124abb86 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:56.921331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d333784-3e4d-450c-8821-0f9c124abb86 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:56.926017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8dd78-b917-4238-b3b1-18458dfabf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:56.926692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8dd78-b917-4238-b3b1-18458dfabf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.926973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8dd78-b917-4238-b3b1-18458dfabf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.927249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8dd78-b917-4238-b3b1-18458dfabf5b admin admin] PATH_INFO: `/v3/projects/1f39ddaaf2c6475a96b909b090fcc064/users/9291166c2c3e4ed3b57cbd5b24d9e1f2/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.943028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8dd78-b917-4238-b3b1-18458dfabf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f39ddaaf2c6475a96b909b090fcc064, user_id=9291166c2c3e4ed3b57cbd5b24d9e1f2, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:56.945805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8dd78-b917-4238-b3b1-18458dfabf5b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:56.959501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 864/1741] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:56 2022] PUT /identity/v3/projects/1f39ddaaf2c6475a96b909b090fcc064/users/9291166c2c3e4ed3b57cbd5b24d9e1f2/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:56.970555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a93d-a9ed-4d54-bf12-34008a6e229a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:56.970853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a93d-a9ed-4d54-bf12-34008a6e229a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:56.971124 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a93d-a9ed-4d54-bf12-34008a6e229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:56.999814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-dd83a93d-a9ed-4d54-bf12-34008a6e229a None None] MFA Rules not processed for user `9291166c2c3e4ed3b57cbd5b24d9e1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:57.001509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dd83a93d-a9ed-4d54-bf12-34008a6e229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:57.071110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 878/1742] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:57.075937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8dd78-b917-4238-b3b1-18458dfabf5b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:57.085338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:57.143217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8dd78-b917-4238-b3b1-18458dfabf5b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:57.147783 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd891-5a43-47e9-ae3d-f4694ab66c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:57.148383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd891-5a43-47e9-ae3d-f4694ab66c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:57.148654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd891-5a43-47e9-ae3d-f4694ab66c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:57.148923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd891-5a43-47e9-ae3d-f4694ab66c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:57.149547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd891-5a43-47e9-ae3d-f4694ab66c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:57.151476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd891-5a43-47e9-ae3d-f4694ab66c07 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:57.178379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 865/1743] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:57 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:57.183125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a93d-a9ed-4d54-bf12-34008a6e229a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:57.196301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a93d-a9ed-4d54-bf12-34008a6e229a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:57.231743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:57.268349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b218b-3833-4eb0-8db7-d0c3e5163751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:57.268960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b218b-3833-4eb0-8db7-d0c3e5163751 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:57.269238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b218b-3833-4eb0-8db7-d0c3e5163751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:57.269508 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b218b-3833-4eb0-8db7-d0c3e5163751 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:57.270140 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b218b-3833-4eb0-8db7-d0c3e5163751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:57.272121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b218b-3833-4eb0-8db7-d0c3e5163751 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:57.292846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 879/1744] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 16:59:57 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 16:59:57.296701 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd891-5a43-47e9-ae3d-f4694ab66c07 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:57.307656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd891-5a43-47e9-ae3d-f4694ab66c07 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:57.314040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5781-7379-4aa4-b0b7-ca009eac0f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:57.314839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5781-7379-4aa4-b0b7-ca009eac0f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:57.315122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5781-7379-4aa4-b0b7-ca009eac0f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:57.315396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5781-7379-4aa4-b0b7-ca009eac0f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:57.316041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5781-7379-4aa4-b0b7-ca009eac0f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:57.317845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5781-7379-4aa4-b0b7-ca009eac0f04 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:57.329759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 866/1745] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 16:59:57.334081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b218b-3833-4eb0-8db7-d0c3e5163751 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:57.344735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b218b-3833-4eb0-8db7-d0c3e5163751 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:57.350249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad40a8-5ff0-4a84-a34d-26c2f5331184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:57.350937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad40a8-5ff0-4a84-a34d-26c2f5331184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:57.351219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad40a8-5ff0-4a84-a34d-26c2f5331184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:57.351494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad40a8-5ff0-4a84-a34d-26c2f5331184 admin admin] PATH_INFO: `/v3/projects/7f6e3ad2301944979b3351fd93c36fb2/users/e80f012b9d9d4e0fb81522be41b046bc/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:57.367185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad40a8-5ff0-4a84-a34d-26c2f5331184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6e3ad2301944979b3351fd93c36fb2, user_id=e80f012b9d9d4e0fb81522be41b046bc, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:57.370121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad40a8-5ff0-4a84-a34d-26c2f5331184 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:57.394876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 880/1746] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:57 2022] PUT /identity/v3/projects/7f6e3ad2301944979b3351fd93c36fb2/users/e80f012b9d9d4e0fb81522be41b046bc/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 16:59:57.396010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5781-7379-4aa4-b0b7-ca009eac0f04 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:57.411779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5781-7379-4aa4-b0b7-ca009eac0f04 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:57.474212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc16abd-7d0d-46bd-827c-3a2e605223cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:57.474869 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc16abd-7d0d-46bd-827c-3a2e605223cf admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:57.475147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc16abd-7d0d-46bd-827c-3a2e605223cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:57.475417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc16abd-7d0d-46bd-827c-3a2e605223cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:57.476058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc16abd-7d0d-46bd-827c-3a2e605223cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:57.477639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc16abd-7d0d-46bd-827c-3a2e605223cf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:57.488178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 867/1747] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 16:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 16:59:57.492171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad40a8-5ff0-4a84-a34d-26c2f5331184 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:57.502922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad40a8-5ff0-4a84-a34d-26c2f5331184 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:57.507540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049f90-e241-4d19-b700-5f3daa60fcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:57.508189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049f90-e241-4d19-b700-5f3daa60fcba admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:57.508467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049f90-e241-4d19-b700-5f3daa60fcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:57.508745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049f90-e241-4d19-b700-5f3daa60fcba admin admin] PATH_INFO: `/v3/projects/7f6e3ad2301944979b3351fd93c36fb2/users/e80f012b9d9d4e0fb81522be41b046bc/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:57.510718 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af049f90-e241-4d19-b700-5f3daa60fcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6e3ad2301944979b3351fd93c36fb2, user_id=e80f012b9d9d4e0fb81522be41b046bc, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:57.513887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af049f90-e241-4d19-b700-5f3daa60fcba admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:57.524393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 881/1748] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 16:59:57 2022] PUT /identity/v3/projects/7f6e3ad2301944979b3351fd93c36fb2/users/e80f012b9d9d4e0fb81522be41b046bc/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:57.536215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480e3c4-b374-44a4-a708-2e851c47032b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:57.536501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480e3c4-b374-44a4-a708-2e851c47032b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:57.536929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480e3c4-b374-44a4-a708-2e851c47032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:57.571890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2480e3c4-b374-44a4-a708-2e851c47032b None None] MFA Rules not processed for user `e80f012b9d9d4e0fb81522be41b046bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:57.573111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2480e3c4-b374-44a4-a708-2e851c47032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:57.658167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 868/1749] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:57.672953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049f90-e241-4d19-b700-5f3daa60fcba admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:57.753485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049f90-e241-4d19-b700-5f3daa60fcba admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:57.760594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e15d8e-6d28-42c3-9485-ec3e2ccfddb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:57.761349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e15d8e-6d28-42c3-9485-ec3e2ccfddb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:57.762565 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e15d8e-6d28-42c3-9485-ec3e2ccfddb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:57.762815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e15d8e-6d28-42c3-9485-ec3e2ccfddb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:57.832562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e15d8e-6d28-42c3-9485-ec3e2ccfddb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:57.832562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e15d8e-6d28-42c3-9485-ec3e2ccfddb0 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:57.842221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 882/1750] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 16:59:58.713757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480e3c4-b374-44a4-a708-2e851c47032b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:58.715498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2480e3c4-b374-44a4-a708-2e851c47032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:58.720861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:58.786732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480e3c4-b374-44a4-a708-2e851c47032b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:58.791241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:58.791867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:58.792144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:58.792413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] PATH_INFO: `/v3/users/7106814831964de18a0fc834e68ff0bc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:58.793546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7106814831964de18a0fc834e68ff0bc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:58.795520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:58.841371 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7106814831964de18a0fc834e68ff0bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:58.853311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7106814831964de18a0fc834e68ff0bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:58.861663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7106814831964de18a0fc834e68ff0bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:58.862362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7106814831964de18a0fc834e68ff0bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:58.870337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7106814831964de18a0fc834e68ff0bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:58.877811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 869/1751] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:58 2022] DELETE /identity/v3/users/7106814831964de18a0fc834e68ff0bc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:58.882504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b945ce-d8fb-47e7-ac80-6f471275ac39 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:58.883017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b945ce-d8fb-47e7-ac80-6f471275ac39 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:58.883193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b945ce-d8fb-47e7-ac80-6f471275ac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:58.904865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e0b945ce-d8fb-47e7-ac80-6f471275ac39 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:58.906143 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e0b945ce-d8fb-47e7-ac80-6f471275ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:58.943226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:58.969829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 883/1752] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:58.979772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:58.982307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.042904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd88372-1f55-4cae-b5b9-7f53a7c785ed admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:59.048211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:59.048818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.049091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.049357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.058417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:59.061169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:59.070972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 870/1753] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:59:59.393340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b945ce-d8fb-47e7-ac80-6f471275ac39 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:59.395865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e0b945ce-d8fb-47e7-ac80-6f471275ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.421256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b945ce-d8fb-47e7-ac80-6f471275ac39 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:59.439593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:59.440766 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.441777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.442470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] PATH_INFO: `/v3/projects/fec8c13240b644798d00dc7de3d3169b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.445443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec8c13240b644798d00dc7de3d3169b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:59.448128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:59.477950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:59.480195 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.521339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec8c13240b644798d00dc7de3d3169b', 'request_id': 'req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.522712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:59.530719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec8c13240b644798d00dc7de3d3169b', 'request_id': 'req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.547486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec8c13240b644798d00dc7de3d3169b', 'request_id': 'req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.564573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] The token cache is being invalidate because project fec8c13240b644798d00dc7de3d3169b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 16:59:59.564898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.570889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.572979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 884/1754] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 16:59:59 2022] DELETE /identity/v3/projects/fec8c13240b644798d00dc7de3d3169b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:59.574126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:59.576403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.584573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd100-43d9-4141-ac29-074213853e68 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:59.645908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73e2d-3d13-44c2-a19a-c10525e9ba29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:59.646511 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73e2d-3d13-44c2-a19a-c10525e9ba29 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.646817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73e2d-3d13-44c2-a19a-c10525e9ba29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.647180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73e2d-3d13-44c2-a19a-c10525e9ba29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.649026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-05c73e2d-3d13-44c2-a19a-c10525e9ba29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.654332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ebdc-820d-4ebb-a7e1-4e4b5019a3d1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:59.660112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:59.660742 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.661024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.661301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] PATH_INFO: `/v3/users/554064e153e64426b6eb1a509cd77b96` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.662439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554064e153e64426b6eb1a509cd77b96)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:59.664369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:59.711794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73e2d-3d13-44c2-a19a-c10525e9ba29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:59.713143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73e2d-3d13-44c2-a19a-c10525e9ba29 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:59.713277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554064e153e64426b6eb1a509cd77b96'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.713809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554064e153e64426b6eb1a509cd77b96'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.721088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554064e153e64426b6eb1a509cd77b96'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.722417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 871/1755] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 16:59:59.725184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4dc9-ec40-4eab-9650-d44c9e68023c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.725472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4dc9-ec40-4eab-9650-d44c9e68023c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.725742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4dc9-ec40-4eab-9650-d44c9e68023c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.729059 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 16:59:59.738333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554064e153e64426b6eb1a509cd77b96'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.739377 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61ac39a9-b740-46e8-8915-3e5394e7b7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554064e153e64426b6eb1a509cd77b96'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 16:59:59.751397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-842e4dc9-ec40-4eab-9650-d44c9e68023c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:59.752670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-842e4dc9-ec40-4eab-9650-d44c9e68023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.763986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 885/1756] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 16:59:59 2022] DELETE /identity/v3/users/554064e153e64426b6eb1a509cd77b96 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 16:59:59.766099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 872/1757] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 16:59:59.772485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908584b-d32e-4c9b-a389-3ac68500f859 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.772768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908584b-d32e-4c9b-a389-3ac68500f859 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.773063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908584b-d32e-4c9b-a389-3ac68500f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.774552 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6e879-4b89-426a-94f3-13f99a02c8a8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.774877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6e879-4b89-426a-94f3-13f99a02c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.775157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6e879-4b89-426a-94f3-13f99a02c8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.800026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-66b6e879-4b89-426a-94f3-13f99a02c8a8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:59.801222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-66b6e879-4b89-426a-94f3-13f99a02c8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.805042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d908584b-d32e-4c9b-a389-3ac68500f859 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 16:59:59.806623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d908584b-d32e-4c9b-a389-3ac68500f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.901250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 873/1758] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:59.902068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6e879-4b89-426a-94f3-13f99a02c8a8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:59.915931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6e879-4b89-426a-94f3-13f99a02c8a8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:59.917690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 886/1759] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 16:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 16:59:59.921704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:59.922323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.922648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.922977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.923574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 16:59:59.924029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:59.925633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 16:59:59.930967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908584b-d32e-4c9b-a389-3ac68500f859 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:59.932385 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d908584b-d32e-4c9b-a389-3ac68500f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 16:59:59.942583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 874/1760] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 16:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 16:59:59.947269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 16:59:59.978337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b63c7a-2b66-44f9-b4d5-e468d5466432 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 16:59:59.985305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d824d8c-fc3b-4975-95f8-899559c5e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 16:59:59.990359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d824d8c-fc3b-4975-95f8-899559c5e85e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 16:59:59.990789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d824d8c-fc3b-4975-95f8-899559c5e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 16:59:59.991081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d824d8c-fc3b-4975-95f8-899559c5e85e admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 16:59:59.991980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d824d8c-fc3b-4975-95f8-899559c5e85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 16:59:59.999145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d824d8c-fc3b-4975-95f8-899559c5e85e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.014782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908584b-d32e-4c9b-a389-3ac68500f859 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:00.017858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:00.019772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05827a5-2146-469a-90dc-ab6ceaebe4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:00.020683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05827a5-2146-469a-90dc-ab6ceaebe4cb service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.021156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05827a5-2146-469a-90dc-ab6ceaebe4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.021419 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05827a5-2146-469a-90dc-ab6ceaebe4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.033335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05827a5-2146-469a-90dc-ab6ceaebe4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:00.035174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05827a5-2146-469a-90dc-ab6ceaebe4cb service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.037932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 875/1761] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 16:59:59 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:00.044471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d824d8c-fc3b-4975-95f8-899559c5e85e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:00.048088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 887/1762] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 16:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:00.145246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d824d8c-fc3b-4975-95f8-899559c5e85e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:00.152393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac185-9d8b-4e7a-b5e4-84d2e7c7d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:00.153336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac185-9d8b-4e7a-b5e4-84d2e7c7d478 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.153654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac185-9d8b-4e7a-b5e4-84d2e7c7d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.153970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac185-9d8b-4e7a-b5e4-84d2e7c7d478 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.154771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac185-9d8b-4e7a-b5e4-84d2e7c7d478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:00.157036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac185-9d8b-4e7a-b5e4-84d2e7c7d478 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.189559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 876/1763] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:00 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:00.196073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05827a5-2146-469a-90dc-ab6ceaebe4cb service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:00.212896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05827a5-2146-469a-90dc-ab6ceaebe4cb service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:00.219486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01eed-1a2c-4145-a417-42c9e2c3984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:00.220141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01eed-1a2c-4145-a417-42c9e2c3984c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.220720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01eed-1a2c-4145-a417-42c9e2c3984c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.221617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01eed-1a2c-4145-a417-42c9e2c3984c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.222602 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af01eed-1a2c-4145-a417-42c9e2c3984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:00.224610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af01eed-1a2c-4145-a417-42c9e2c3984c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.268236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 888/1764] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:00.269542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac185-9d8b-4e7a-b5e4-84d2e7c7d478 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:00.281571 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac185-9d8b-4e7a-b5e4-84d2e7c7d478 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:00.287766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd7386-a0bc-4037-be96-6e59a59a653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:00.288578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7386-a0bc-4037-be96-6e59a59a653f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.288938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7386-a0bc-4037-be96-6e59a59a653f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.289631 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7386-a0bc-4037-be96-6e59a59a653f admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.290464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd7386-a0bc-4037-be96-6e59a59a653f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:00.292295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd7386-a0bc-4037-be96-6e59a59a653f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.305441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 877/1765] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:00.310372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01eed-1a2c-4145-a417-42c9e2c3984c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:00.321347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01eed-1a2c-4145-a417-42c9e2c3984c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:00.326865 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:00.327531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.327975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.328370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] PATH_INFO: `/v3/projects/3660e036c83f4c25a471dd04b606b8d1/users/baa5415081434296b217c94ed1bfe143/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.347447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3660e036c83f4c25a471dd04b606b8d1, user_id=baa5415081434296b217c94ed1bfe143, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:00.350878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.378564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 889/1766] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:00 2022] PUT /identity/v3/projects/3660e036c83f4c25a471dd04b606b8d1/users/baa5415081434296b217c94ed1bfe143/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:00.386582 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39c2af-754a-4910-b466-c9c7b8513562 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.387526 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39c2af-754a-4910-b466-c9c7b8513562 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.387851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39c2af-754a-4910-b466-c9c7b8513562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.424105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ac39c2af-754a-4910-b466-c9c7b8513562 None None] MFA Rules not processed for user `baa5415081434296b217c94ed1bfe143`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:00.425323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ac39c2af-754a-4910-b466-c9c7b8513562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:00.526730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:00.529291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:00.530686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 878/1767] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:00.541967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39c2af-754a-4910-b466-c9c7b8513562 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:00.544749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ac39c2af-754a-4910-b466-c9c7b8513562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:00.622796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48096d7-d043-4b7c-b038-b59788f948e4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:00.631605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39c2af-754a-4910-b466-c9c7b8513562 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:00.633845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:00.634712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.635192 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.635639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.635790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:00.636556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.637096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.637549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.639899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:00.645913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:00.659726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:00.662350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.678679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 879/1768] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:00:00.681479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:00.686142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:00.697797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:00.737255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:00.741975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.757622 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 890/1769] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:00.810912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e9335-9c5b-4dce-ae61-f409c51039fd service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:00.819976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:00.821948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:00.823778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:00.825429 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] PATH_INFO: `/v3/projects/6901e78d5fa342089ecd0b5747282880` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:00.827741 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6901e78d5fa342089ecd0b5747282880)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:00.835058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:00.928446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6901e78d5fa342089ecd0b5747282880', 'request_id': 'req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:00.938847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6901e78d5fa342089ecd0b5747282880', 'request_id': 'req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:00.948461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6901e78d5fa342089ecd0b5747282880', 'request_id': 'req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:00.975491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] The token cache is being invalidate because project 6901e78d5fa342089ecd0b5747282880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:00.976181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:00.977215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:00.979155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 880/1770] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:00 2022] DELETE /identity/v3/projects/6901e78d5fa342089ecd0b5747282880 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:00.984042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:00.998402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118632c-8d01-4214-977a-d775b47f4e7b service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:01.106038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:01.106981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:01.107743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:01.108275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] PATH_INFO: `/v3/users/e0030d3d72e542afbcb01732904cf7bc` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:01.109809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0030d3d72e542afbcb01732904cf7bc)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:01.111745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:01.173081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0030d3d72e542afbcb01732904cf7bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.173740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0030d3d72e542afbcb01732904cf7bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.182736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0030d3d72e542afbcb01732904cf7bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.195973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0030d3d72e542afbcb01732904cf7bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.196685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c2d242aa-83ff-477d-9947-518fcbfe97c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0030d3d72e542afbcb01732904cf7bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.209758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 891/1771] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:00 2022] DELETE /identity/v3/users/e0030d3d72e542afbcb01732904cf7bc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:01.660883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:01.662769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:01.679983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb4348-9a94-4e50-8e7d-4a00f3d05957 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:01.753111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:01.753778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:01.754058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:01.754347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] PATH_INFO: `/v3/projects/085e046fd90040cbafb833fc08618a0d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:01.755534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085e046fd90040cbafb833fc08618a0d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:01.757572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:01.800975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:01.812603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085e046fd90040cbafb833fc08618a0d', 'request_id': 'req-bd72e5f6-6574-4ce2-b7d3-7899e6569414'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.821002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085e046fd90040cbafb833fc08618a0d', 'request_id': 'req-bd72e5f6-6574-4ce2-b7d3-7899e6569414'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.828515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085e046fd90040cbafb833fc08618a0d', 'request_id': 'req-bd72e5f6-6574-4ce2-b7d3-7899e6569414'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.846356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] The token cache is being invalidate because project 085e046fd90040cbafb833fc08618a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:01.846683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.847312 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bd72e5f6-6574-4ce2-b7d3-7899e6569414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:01.848813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 881/1772] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:01 2022] DELETE /identity/v3/projects/085e046fd90040cbafb833fc08618a0d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:01.853598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab7ea-4a57-4bac-ba0b-40f396741d10 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:01.853889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab7ea-4a57-4bac-ba0b-40f396741d10 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:01.854167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab7ea-4a57-4bac-ba0b-40f396741d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:01.875578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ed3ab7ea-4a57-4bac-ba0b-40f396741d10 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:01.876801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ed3ab7ea-4a57-4bac-ba0b-40f396741d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:01.898715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:01.962620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 892/1773] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:01.971294 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f837d8-c107-4682-97ee-04cf12570a8d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:01.971717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f837d8-c107-4682-97ee-04cf12570a8d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:01.972118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f837d8-c107-4682-97ee-04cf12570a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:01.999606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-56f837d8-c107-4682-97ee-04cf12570a8d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:02.001142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-56f837d8-c107-4682-97ee-04cf12570a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:02.017176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ab7ea-4a57-4bac-ba0b-40f396741d10 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:02.026698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 882/1774] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:02.028957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ab7ea-4a57-4bac-ba0b-40f396741d10 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:02.034176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:02.034176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:02.034410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:02.034722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:02.037273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:00:02.037273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:02.037578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:02.054047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 893/1775] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:00:02.056082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f837d8-c107-4682-97ee-04cf12570a8d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:02.067424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f837d8-c107-4682-97ee-04cf12570a8d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:02.072765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190722d-1c07-4c87-a559-4d45b0bf126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:02.073421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190722d-1c07-4c87-a559-4d45b0bf126e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:02.073707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190722d-1c07-4c87-a559-4d45b0bf126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:02.074009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190722d-1c07-4c87-a559-4d45b0bf126e admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:02.078111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190722d-1c07-4c87-a559-4d45b0bf126e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:02.078111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190722d-1c07-4c87-a559-4d45b0bf126e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:02.133371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:02.145127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 883/1776] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:02 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:00:02.148801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bc6cc-83cf-4391-8354-1c7d9323c51c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:02.296213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d68d-7084-4a96-a67d-14fa549f1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:02.296857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d68d-7084-4a96-a67d-14fa549f1b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:02.297151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d68d-7084-4a96-a67d-14fa549f1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:02.297469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900d68d-7084-4a96-a67d-14fa549f1b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:02.300382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d68d-7084-4a96-a67d-14fa549f1b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:02.304711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900d68d-7084-4a96-a67d-14fa549f1b9e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:02.361968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 894/1777] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:02 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:02.365389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190722d-1c07-4c87-a559-4d45b0bf126e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:02.383768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190722d-1c07-4c87-a559-4d45b0bf126e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:02.392110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70c9e3-0f5b-4993-8733-8013711d943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:02.393502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c9e3-0f5b-4993-8733-8013711d943a admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:02.393929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c9e3-0f5b-4993-8733-8013711d943a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:02.394852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c9e3-0f5b-4993-8733-8013711d943a admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:02.396089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70c9e3-0f5b-4993-8733-8013711d943a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:02.398404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70c9e3-0f5b-4993-8733-8013711d943a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:02.446813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d68d-7084-4a96-a67d-14fa549f1b9e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:02.447214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 884/1778] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:02.468027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900d68d-7084-4a96-a67d-14fa549f1b9e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:02.481991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75e94a-7564-4ac3-a55a-1974f48b7786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:02.483029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75e94a-7564-4ac3-a55a-1974f48b7786 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:02.483380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75e94a-7564-4ac3-a55a-1974f48b7786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:02.485344 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75e94a-7564-4ac3-a55a-1974f48b7786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:02.486093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75e94a-7564-4ac3-a55a-1974f48b7786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:02.490392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75e94a-7564-4ac3-a55a-1974f48b7786 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:02.511161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70c9e3-0f5b-4993-8733-8013711d943a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:02.517709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 895/1779] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:02.523295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70c9e3-0f5b-4993-8733-8013711d943a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:02.530033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:02.547333 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:02.547707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:02.548061 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] PATH_INFO: `/v3/projects/d588b398d8d14cec8536a7e647b25114/users/bef8a63e184a472a85775a1e56127c31/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:02.578945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d588b398d8d14cec8536a7e647b25114, user_id=bef8a63e184a472a85775a1e56127c31, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:02.582282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:02.614891 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 885/1780] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:02 2022] PUT /identity/v3/projects/d588b398d8d14cec8536a7e647b25114/users/bef8a63e184a472a85775a1e56127c31/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:02.620187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69852904-9603-4424-b837-1633e6036d4d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:02.620481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69852904-9603-4424-b837-1633e6036d4d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:02.622952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69852904-9603-4424-b837-1633e6036d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:02.653719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-69852904-9603-4424-b837-1633e6036d4d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:02.662540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-69852904-9603-4424-b837-1633e6036d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:02.738238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 896/1781] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:02.749768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:02.751698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:02.816882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac8c21-8d4e-4439-ae4d-7ae478e07e02 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:02.821234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190df85-6b57-4b7e-8e7b-c5f860187bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:02.821918 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190df85-6b57-4b7e-8e7b-c5f860187bfb service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:02.822260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190df85-6b57-4b7e-8e7b-c5f860187bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:02.823256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190df85-6b57-4b7e-8e7b-c5f860187bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:02.833971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190df85-6b57-4b7e-8e7b-c5f860187bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:02.835553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190df85-6b57-4b7e-8e7b-c5f860187bfb service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:02.846507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 886/1782] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:04.194839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9a4e9-e95b-4326-bb8e-605e49f72634 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.195335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9a4e9-e95b-4326-bb8e-605e49f72634 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.195536 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9a4e9-e95b-4326-bb8e-605e49f72634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.244099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4ca9a4e9-e95b-4326-bb8e-605e49f72634 None None] MFA Rules not processed for user `bef8a63e184a472a85775a1e56127c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:04.245437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4ca9a4e9-e95b-4326-bb8e-605e49f72634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:04.271307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:04.358246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 897/1783] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:04.362540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190df85-6b57-4b7e-8e7b-c5f860187bfb service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:04.376656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190df85-6b57-4b7e-8e7b-c5f860187bfb service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:04.382248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61abe6-cfef-48ff-8985-57b95c66910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:04.383395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61abe6-cfef-48ff-8985-57b95c66910d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.383670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61abe6-cfef-48ff-8985-57b95c66910d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.383948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61abe6-cfef-48ff-8985-57b95c66910d admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.384604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61abe6-cfef-48ff-8985-57b95c66910d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:04.387626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61abe6-cfef-48ff-8985-57b95c66910d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:04.417292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 887/1784] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:04 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:04.422175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9a4e9-e95b-4326-bb8e-605e49f72634 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:04.436463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9a4e9-e95b-4326-bb8e-605e49f72634 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:04.506477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5fd8f-8f2f-468d-bda7-6ddf05505290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:04.507254 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5fd8f-8f2f-468d-bda7-6ddf05505290 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.507612 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5fd8f-8f2f-468d-bda7-6ddf05505290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.508175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5fd8f-8f2f-468d-bda7-6ddf05505290 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.508669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5fd8f-8f2f-468d-bda7-6ddf05505290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:04.511131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5fd8f-8f2f-468d-bda7-6ddf05505290 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:04.537271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 898/1785] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:04 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:04.538654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61abe6-cfef-48ff-8985-57b95c66910d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:04.552249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61abe6-cfef-48ff-8985-57b95c66910d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:04.559371 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13aa0d-8106-4fef-a479-87f4eef97ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:04.559984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13aa0d-8106-4fef-a479-87f4eef97ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.560265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13aa0d-8106-4fef-a479-87f4eef97ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.560539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13aa0d-8106-4fef-a479-87f4eef97ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.561186 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13aa0d-8106-4fef-a479-87f4eef97ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:04.562836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13aa0d-8106-4fef-a479-87f4eef97ec2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:04.578009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 888/1786] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:04.582157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5fd8f-8f2f-468d-bda7-6ddf05505290 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:04.595020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5fd8f-8f2f-468d-bda7-6ddf05505290 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:04.601234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab64e3-7883-4914-9765-7ef18d7602fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:04.601950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab64e3-7883-4914-9765-7ef18d7602fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.602232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab64e3-7883-4914-9765-7ef18d7602fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.602504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab64e3-7883-4914-9765-7ef18d7602fb admin admin] PATH_INFO: `/v3/projects/dc7a9014e7114391a0b294421febf79d/users/7b63b149521240b7a7dbe92a2a4dc29c/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.624825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab64e3-7883-4914-9765-7ef18d7602fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7a9014e7114391a0b294421febf79d, user_id=7b63b149521240b7a7dbe92a2a4dc29c, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:04.627937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab64e3-7883-4914-9765-7ef18d7602fb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:04.646902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 899/1787] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:04 2022] PUT /identity/v3/projects/dc7a9014e7114391a0b294421febf79d/users/7b63b149521240b7a7dbe92a2a4dc29c/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:00:04.651423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13aa0d-8106-4fef-a479-87f4eef97ec2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:04.664777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13aa0d-8106-4fef-a479-87f4eef97ec2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:04.703184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:04.742540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085504a4-8d4b-4f2e-aea8-6625c61952b1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.743086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085504a4-8d4b-4f2e-aea8-6625c61952b1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.743364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085504a4-8d4b-4f2e-aea8-6625c61952b1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.744950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 900/1788] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 17:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 17:00:04.755416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62627-f84e-462b-b9da-cc56c2db493b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.755893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62627-f84e-462b-b9da-cc56c2db493b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.756033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a278c4-050a-4914-889f-5915ddbc22a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:04.756415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62627-f84e-462b-b9da-cc56c2db493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.756935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a278c4-050a-4914-889f-5915ddbc22a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.757233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a278c4-050a-4914-889f-5915ddbc22a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.757654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a278c4-050a-4914-889f-5915ddbc22a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.758292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a278c4-050a-4914-889f-5915ddbc22a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:04.759912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a278c4-050a-4914-889f-5915ddbc22a0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:04.781326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 889/1789] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:04.785068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a278c4-050a-4914-889f-5915ddbc22a0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:04.787274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-97a62627-f84e-462b-b9da-cc56c2db493b None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:04.789149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-97a62627-f84e-462b-b9da-cc56c2db493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:04.796691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a278c4-050a-4914-889f-5915ddbc22a0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:04.811283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:04.811969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.812250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.812525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] PATH_INFO: `/v3/projects/dc7a9014e7114391a0b294421febf79d/users/7b63b149521240b7a7dbe92a2a4dc29c/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.815214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7a9014e7114391a0b294421febf79d, user_id=7b63b149521240b7a7dbe92a2a4dc29c, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:04.818083 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:04.851396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 890/1790] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:04 2022] PUT /identity/v3/projects/dc7a9014e7114391a0b294421febf79d/users/7b63b149521240b7a7dbe92a2a4dc29c/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:00:04.870886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:04.875296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:04.932984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 901/1791] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 17:00:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:04.946606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a62627-f84e-462b-b9da-cc56c2db493b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:04.949498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-97a62627-f84e-462b-b9da-cc56c2db493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:04.967024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a62627-f84e-462b-b9da-cc56c2db493b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:04.967604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eea831-8cfa-4ff2-89d1-d54c738f7b2b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:04.973031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:04.973790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:04.974142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:04.974503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] PATH_INFO: `/v3/users/011c3876fb3c4e5296f5fa164b7b886b` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:04.975876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011c3876fb3c4e5296f5fa164b7b886b)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:04.978339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:04.984485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:05.053908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:05.054553 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.054795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.055046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.055664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011c3876fb3c4e5296f5fa164b7b886b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.065245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:05.066913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:05.074941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011c3876fb3c4e5296f5fa164b7b886b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.079319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 902/1792] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:00:05.085853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011c3876fb3c4e5296f5fa164b7b886b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.087311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011c3876fb3c4e5296f5fa164b7b886b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.112312 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011c3876fb3c4e5296f5fa164b7b886b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.125459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 891/1793] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:04 2022] DELETE /identity/v3/users/011c3876fb3c4e5296f5fa164b7b886b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:00:05.379825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:05.381399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:05.387579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:05.389554 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:05.400979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ebf8-e727-4529-aef2-7f59da299624 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:05.465221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:05.497871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:05.498837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.499311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.499793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] PATH_INFO: `/v3/users/e12ddf9db9704249993457171091c430` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.501140 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12ddf9db9704249993457171091c430)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:05.503391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:05.509839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73137-56f6-488a-adff-698062f01bd1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:05.520987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:05.521648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.522565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.522565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] PATH_INFO: `/v3/projects/8d4783c327b0464f8ab59e9f72b330f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.523707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4783c327b0464f8ab59e9f72b330f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:05.525923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:05.567726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12ddf9db9704249993457171091c430'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.568558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12ddf9db9704249993457171091c430'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.580208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12ddf9db9704249993457171091c430'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.587925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4783c327b0464f8ab59e9f72b330f8', 'request_id': 'req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.593712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12ddf9db9704249993457171091c430'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.594447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-486e6a6a-c7ae-40c4-9a40-de2b3250be10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12ddf9db9704249993457171091c430'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.595284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4783c327b0464f8ab59e9f72b330f8', 'request_id': 'req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.603017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4783c327b0464f8ab59e9f72b330f8', 'request_id': 'req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.609720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 903/1794] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:05 2022] DELETE /identity/v3/users/e12ddf9db9704249993457171091c430 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:05.614122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8f638-75a6-406b-9c78-9a06a0907243 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.614482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8f638-75a6-406b-9c78-9a06a0907243 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.614916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8f638-75a6-406b-9c78-9a06a0907243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.620094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] The token cache is being invalidate because project 8d4783c327b0464f8ab59e9f72b330f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:05.620389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.621747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ddf9a02e-a7c1-4543-bdc7-943e6ba468ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:05.623583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 892/1795] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:05 2022] DELETE /identity/v3/projects/8d4783c327b0464f8ab59e9f72b330f8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:05.629105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ffcd3-3419-42e8-af11-a9c8a30cea59 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.629611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ffcd3-3419-42e8-af11-a9c8a30cea59 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.630984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ffcd3-3419-42e8-af11-a9c8a30cea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.636153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-37f8f638-75a6-406b-9c78-9a06a0907243 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:05.637653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-37f8f638-75a6-406b-9c78-9a06a0907243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:05.656999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2e0ffcd3-3419-42e8-af11-a9c8a30cea59 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:05.659360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2e0ffcd3-3419-42e8-af11-a9c8a30cea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:05.659944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:05.706663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 904/1796] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:05.716221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8f638-75a6-406b-9c78-9a06a0907243 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:05.717610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-37f8f638-75a6-406b-9c78-9a06a0907243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:05.754558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 893/1797] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:05.766497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a9051-7e2b-45b9-83be-d0fb8234d6c0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.766820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a9051-7e2b-45b9-83be-d0fb8234d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.767788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a9051-7e2b-45b9-83be-d0fb8234d6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.789786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-576a9051-7e2b-45b9-83be-d0fb8234d6c0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:05.791098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-576a9051-7e2b-45b9-83be-d0fb8234d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:05.800758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8f638-75a6-406b-9c78-9a06a0907243 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:05.804515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 894/1798] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:05.805820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dc3b7-de4a-44ba-bc86-c56747c00780 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.806102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dc3b7-de4a-44ba-bc86-c56747c00780 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.806273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f57c6-b192-45b9-9d9a-debe2314a7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:05.806405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dc3b7-de4a-44ba-bc86-c56747c00780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.806884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f57c6-b192-45b9-9d9a-debe2314a7ba service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.808134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f57c6-b192-45b9-9d9a-debe2314a7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.809048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f57c6-b192-45b9-9d9a-debe2314a7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.819626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f57c6-b192-45b9-9d9a-debe2314a7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:05.821527 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f57c6-b192-45b9-9d9a-debe2314a7ba service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:05.832845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 905/1799] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:00:05.833613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f57c6-b192-45b9-9d9a-debe2314a7ba service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:05.838171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0f4dc3b7-de4a-44ba-bc86-c56747c00780 None None] MFA Rules not processed for user `7b63b149521240b7a7dbe92a2a4dc29c`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:05.839426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0f4dc3b7-de4a-44ba-bc86-c56747c00780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:05.845022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f57c6-b192-45b9-9d9a-debe2314a7ba service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:05.851271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:05.852041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.852324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.852648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.853251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:00:05.853558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:05.855310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:05.894920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 906/1800] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:00:05.895984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:05.904392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:05.916629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc8e6f-4a20-4d2b-87ab-2f2673a247a5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:05.922792 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4c7d7-bce3-4f66-babc-18260af026f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:05.923554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4c7d7-bce3-4f66-babc-18260af026f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.923908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4c7d7-bce3-4f66-babc-18260af026f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.924190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4c7d7-bce3-4f66-babc-18260af026f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.924923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4c7d7-bce3-4f66-babc-18260af026f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:05.926989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4c7d7-bce3-4f66-babc-18260af026f9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:05.943482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 895/1801] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:05.956608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07b8b-00db-4306-8a4e-b627482a0632 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:05.956946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07b8b-00db-4306-8a4e-b627482a0632 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:05.957184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07b8b-00db-4306-8a4e-b627482a0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:05.961030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 907/1802] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:05 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:00:05.965281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4c7d7-bce3-4f66-babc-18260af026f9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:05.981126 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-97f07b8b-00db-4306-8a4e-b627482a0632 None None] MFA Rules not processed for user `bef8a63e184a472a85775a1e56127c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:05.982404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-97f07b8b-00db-4306-8a4e-b627482a0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:06.053838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4c7d7-bce3-4f66-babc-18260af026f9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:06.060823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d9ce5-b3be-454f-ad13-779f285a2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:06.061594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9ce5-b3be-454f-ad13-779f285a2e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.061770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9ce5-b3be-454f-ad13-779f285a2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.062046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9ce5-b3be-454f-ad13-779f285a2e8f admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.062770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d9ce5-b3be-454f-ad13-779f285a2e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:06.064758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d9ce5-b3be-454f-ad13-779f285a2e8f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:06.069196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 896/1803] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:06.077544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f07b8b-00db-4306-8a4e-b627482a0632 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:06.079147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-97f07b8b-00db-4306-8a4e-b627482a0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:06.098537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 908/1804] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:05 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:06.102462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d9ce5-b3be-454f-ad13-779f285a2e8f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:06.113695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d9ce5-b3be-454f-ad13-779f285a2e8f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:06.119249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02965d39-58e8-410c-ba20-c4b4144d4bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:06.119858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965d39-58e8-410c-ba20-c4b4144d4bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.120139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965d39-58e8-410c-ba20-c4b4144d4bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.120413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965d39-58e8-410c-ba20-c4b4144d4bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.121920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02965d39-58e8-410c-ba20-c4b4144d4bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:06.123428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02965d39-58e8-410c-ba20-c4b4144d4bd7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:06.139432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 909/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:00:06.140516 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02965d39-58e8-410c-ba20-c4b4144d4bd7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:06.152138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02965d39-58e8-410c-ba20-c4b4144d4bd7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:06.159703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:06.160312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.160591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.160915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.161623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:06.163868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:06.180751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 910/1806] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:06.182877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:06.187148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:06.203035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:06.206081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f07b8b-00db-4306-8a4e-b627482a0632 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:06.209418 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084faceb-333d-4f65-87f0-974b174a0722 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:06.213512 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:06.214188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.214562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.215057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.216974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:06.218023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:06.219037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.219414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.220541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] PATH_INFO: `/v3/projects/22dbc775f4114f71bcfde8920ebb9d1e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.221755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22dbc775f4114f71bcfde8920ebb9d1e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:06.223829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:06.229354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:06.231541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:06.241592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 897/1807] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:00:06.242889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:06.255683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebb381-e5e8-4707-b670-9cb290e7470a service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:06.262732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790d172-568e-4bc8-976f-7b81acb78124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:06.263464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790d172-568e-4bc8-976f-7b81acb78124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.263751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790d172-568e-4bc8-976f-7b81acb78124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.264036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790d172-568e-4bc8-976f-7b81acb78124 admin admin] PATH_INFO: `/v3/projects/adeb4be372184d5496443a64c6cc545b/users/05ace9c538754a1cad4a6dc9fc8b7bfb/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.285253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790d172-568e-4bc8-976f-7b81acb78124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adeb4be372184d5496443a64c6cc545b, user_id=05ace9c538754a1cad4a6dc9fc8b7bfb, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:06.288793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790d172-568e-4bc8-976f-7b81acb78124 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:06.292483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22dbc775f4114f71bcfde8920ebb9d1e', 'request_id': 'req-377fea22-cdad-48b5-b4fc-68bd69222c96'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.302605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22dbc775f4114f71bcfde8920ebb9d1e', 'request_id': 'req-377fea22-cdad-48b5-b4fc-68bd69222c96'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.316781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 898/1808] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:06 2022] PUT /identity/v3/projects/adeb4be372184d5496443a64c6cc545b/users/05ace9c538754a1cad4a6dc9fc8b7bfb/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:06.317950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22dbc775f4114f71bcfde8920ebb9d1e', 'request_id': 'req-377fea22-cdad-48b5-b4fc-68bd69222c96'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.326863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b812353-d793-4e46-a2fe-e629473ecfae None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.327349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b812353-d793-4e46-a2fe-e629473ecfae None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.327773 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b812353-d793-4e46-a2fe-e629473ecfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.357480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] The token cache is being invalidate because project 22dbc775f4114f71bcfde8920ebb9d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:06.357480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.360422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.367198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 911/1809] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:06 2022] DELETE /identity/v3/projects/22dbc775f4114f71bcfde8920ebb9d1e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:06.368334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:06.369746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:06.395036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0b812353-d793-4e46-a2fe-e629473ecfae None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:06.396431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0b812353-d793-4e46-a2fe-e629473ecfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:06.465492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:06.486435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 899/1810] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:06.499868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b812353-d793-4e46-a2fe-e629473ecfae None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:06.502125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0b812353-d793-4e46-a2fe-e629473ecfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:06.508663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fea22-cdad-48b5-b4fc-68bd69222c96 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:06.519320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:06.520232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.520619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.521137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] PATH_INFO: `/v3/users/9291166c2c3e4ed3b57cbd5b24d9e1f2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.522769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9291166c2c3e4ed3b57cbd5b24d9e1f2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:06.525205 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:06.604419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b812353-d793-4e46-a2fe-e629473ecfae None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:06.618936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9291166c2c3e4ed3b57cbd5b24d9e1f2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.619356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02b36a-22a0-4b3a-91d7-97ffb316d02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:06.619738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9291166c2c3e4ed3b57cbd5b24d9e1f2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.620113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b36a-22a0-4b3a-91d7-97ffb316d02b service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:06.620457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b36a-22a0-4b3a-91d7-97ffb316d02b service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:06.621644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b36a-22a0-4b3a-91d7-97ffb316d02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:06.635395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02b36a-22a0-4b3a-91d7-97ffb316d02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:06.636905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02b36a-22a0-4b3a-91d7-97ffb316d02b service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:06.641728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9291166c2c3e4ed3b57cbd5b24d9e1f2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.652080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 900/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:00:06.657521 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9291166c2c3e4ed3b57cbd5b24d9e1f2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.658123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9291166c2c3e4ed3b57cbd5b24d9e1f2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:06.679555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 912/1812] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:06 2022] DELETE /identity/v3/users/9291166c2c3e4ed3b57cbd5b24d9e1f2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:07.196704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02b36a-22a0-4b3a-91d7-97ffb316d02b service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:07.211151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02b36a-22a0-4b3a-91d7-97ffb316d02b service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:07.347698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:07.348231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:07.348700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:07.349117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] PATH_INFO: `/v3/projects/1f39ddaaf2c6475a96b909b090fcc064` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:07.351416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f39ddaaf2c6475a96b909b090fcc064)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:07.354668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:07.429254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f39ddaaf2c6475a96b909b090fcc064', 'request_id': 'req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.438847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f39ddaaf2c6475a96b909b090fcc064', 'request_id': 'req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.452695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f39ddaaf2c6475a96b909b090fcc064', 'request_id': 'req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.471002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] The token cache is being invalidate because project 1f39ddaaf2c6475a96b909b090fcc064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:07.471002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.472251 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.477579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 901/1813] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:07 2022] DELETE /identity/v3/projects/1f39ddaaf2c6475a96b909b090fcc064 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:07.478409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:07.479922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:07.496042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:07.503168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6580d-6159-41f4-a6a0-ba48ec90e941 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:07.668037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:07.668990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:07.669479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:07.671264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] PATH_INFO: `/v3/users/e80f012b9d9d4e0fb81522be41b046bc` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:07.674206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80f012b9d9d4e0fb81522be41b046bc)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:07.676185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:07.779047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80f012b9d9d4e0fb81522be41b046bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.781607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80f012b9d9d4e0fb81522be41b046bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.800860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80f012b9d9d4e0fb81522be41b046bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.835885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80f012b9d9d4e0fb81522be41b046bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.836706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f1a4b50-2eeb-46fb-a11a-c2872891afc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80f012b9d9d4e0fb81522be41b046bc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:07.855828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 913/1814] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:07 2022] DELETE /identity/v3/users/e80f012b9d9d4e0fb81522be41b046bc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:08.521835 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:08.523505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:08.549722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0beeb-4f0f-4c04-a758-30c86e3c7a80 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:08.586049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:08.634699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:08.635431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:08.635801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:08.636179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] PATH_INFO: `/v3/projects/7f6e3ad2301944979b3351fd93c36fb2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:08.637713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6e3ad2301944979b3351fd93c36fb2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:08.639854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:08.724722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6e3ad2301944979b3351fd93c36fb2', 'request_id': 'req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:08.735290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6e3ad2301944979b3351fd93c36fb2', 'request_id': 'req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:08.741426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6e3ad2301944979b3351fd93c36fb2', 'request_id': 'req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:08.775780 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] The token cache is being invalidate because project 7f6e3ad2301944979b3351fd93c36fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:08.776078 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:08.776842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac8a8de8-b06b-4fc5-a1c0-c848a0104db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:08.779575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 902/1815] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:08 2022] DELETE /identity/v3/projects/7f6e3ad2301944979b3351fd93c36fb2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:08.784526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d41cb-30a9-4922-b060-1b78ef7e3ad1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:08.785052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d41cb-30a9-4922-b060-1b78ef7e3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:08.785343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d41cb-30a9-4922-b060-1b78ef7e3ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:08.817019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-745d41cb-30a9-4922-b060-1b78ef7e3ad1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:08.818529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-745d41cb-30a9-4922-b060-1b78ef7e3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:08.952315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 914/1816] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:08.960310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c6da-6e4c-487a-bee1-b8dc5b5c716e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:08.960672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c6da-6e4c-487a-bee1-b8dc5b5c716e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:08.961103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c6da-6e4c-487a-bee1-b8dc5b5c716e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:08.994067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7788c6da-6e4c-487a-bee1-b8dc5b5c716e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:08.997034 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7788c6da-6e4c-487a-bee1-b8dc5b5c716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:09.010028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 903/1817] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:09.014001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d41cb-30a9-4922-b060-1b78ef7e3ad1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.031879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d41cb-30a9-4922-b060-1b78ef7e3ad1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.037285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.037929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.038212 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.038483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.039177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:00:09.039598 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.041309 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.058339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 915/1818] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:00:09.060141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788c6da-6e4c-487a-bee1-b8dc5b5c716e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.070639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788c6da-6e4c-487a-bee1-b8dc5b5c716e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.082178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40532116-8805-4f44-8361-e28bca369554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.082850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40532116-8805-4f44-8361-e28bca369554 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.083123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40532116-8805-4f44-8361-e28bca369554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.083418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40532116-8805-4f44-8361-e28bca369554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.084030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40532116-8805-4f44-8361-e28bca369554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.085964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40532116-8805-4f44-8361-e28bca369554 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.099080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.101158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:09.122603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27df4-c9cc-401e-98c4-235083c0a964 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.127949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.128241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.128526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.128795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] PATH_INFO: `/v3/users/9b8b458d73a440d5b3f74d94e037d2c6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.129986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8b458d73a440d5b3f74d94e037d2c6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.131953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.138008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:09.146721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 904/1819] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:09 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:09.147682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40532116-8805-4f44-8361-e28bca369554 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.196045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8b458d73a440d5b3f74d94e037d2c6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:09.197432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8b458d73a440d5b3f74d94e037d2c6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:09.206362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8b458d73a440d5b3f74d94e037d2c6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:09.220754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8b458d73a440d5b3f74d94e037d2c6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:09.221616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dc73091a-6310-4f85-81d2-b84ca2657aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8b458d73a440d5b3f74d94e037d2c6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:09.241041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 916/1820] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:09 2022] DELETE /identity/v3/users/9b8b458d73a440d5b3f74d94e037d2c6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:09.242835 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edab01-fa1e-47c9-b2df-f7b606913aad None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.243132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edab01-fa1e-47c9-b2df-f7b606913aad None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.243406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edab01-fa1e-47c9-b2df-f7b606913aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.249928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40532116-8805-4f44-8361-e28bca369554 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.268892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-77edab01-fa1e-47c9-b2df-f7b606913aad None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:09.271799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-77edab01-fa1e-47c9-b2df-f7b606913aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:09.294183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:09.339821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.341165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.341669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.341851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.342464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.345579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.374292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 917/1821] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:09.380933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 905/1822] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:09 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:09.382743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edab01-fa1e-47c9-b2df-f7b606913aad None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.382870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.384463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-77edab01-fa1e-47c9-b2df-f7b606913aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:09.386205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:09.400476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edab01-fa1e-47c9-b2df-f7b606913aad None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.405776 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f180fd-5ef5-4f00-87e7-2d495b2bd91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.406412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f180fd-5ef5-4f00-87e7-2d495b2bd91e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.406737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f180fd-5ef5-4f00-87e7-2d495b2bd91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.407170 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f180fd-5ef5-4f00-87e7-2d495b2bd91e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.407839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f180fd-5ef5-4f00-87e7-2d495b2bd91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.409787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f180fd-5ef5-4f00-87e7-2d495b2bd91e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.425217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 918/1823] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:09.429334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f180fd-5ef5-4f00-87e7-2d495b2bd91e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.442038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f180fd-5ef5-4f00-87e7-2d495b2bd91e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.448286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112100e-8a9a-4953-a0c6-16e1ef2091dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.449361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112100e-8a9a-4953-a0c6-16e1ef2091dc admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.450097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112100e-8a9a-4953-a0c6-16e1ef2091dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.450448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112100e-8a9a-4953-a0c6-16e1ef2091dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.451349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112100e-8a9a-4953-a0c6-16e1ef2091dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.453218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112100e-8a9a-4953-a0c6-16e1ef2091dc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.476429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 919/1824] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:09.477626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112100e-8a9a-4953-a0c6-16e1ef2091dc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.495105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112100e-8a9a-4953-a0c6-16e1ef2091dc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.506018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b615-0f17-4bb7-b3f4-1577181d9e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.507009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46d8b4-e119-491e-b149-472e65d73c78 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.507830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b615-0f17-4bb7-b3f4-1577181d9e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.508982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b615-0f17-4bb7-b3f4-1577181d9e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.509941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b615-0f17-4bb7-b3f4-1577181d9e3a admin admin] PATH_INFO: `/v3/projects/a2fad667fcdf479f99f8b8d502b40395/users/1ee653a68f2842b0b8f97aa560697303/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.517543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dab400-bc44-46f4-bd2e-5a9657fa6707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.520337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dab400-bc44-46f4-bd2e-5a9657fa6707 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.520875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dab400-bc44-46f4-bd2e-5a9657fa6707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.521224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dab400-bc44-46f4-bd2e-5a9657fa6707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.543841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dab400-bc44-46f4-bd2e-5a9657fa6707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.545132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dab400-bc44-46f4-bd2e-5a9657fa6707 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.552391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8b615-0f17-4bb7-b3f4-1577181d9e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fad667fcdf479f99f8b8d502b40395, user_id=1ee653a68f2842b0b8f97aa560697303, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.557064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8b615-0f17-4bb7-b3f4-1577181d9e3a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.586849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 906/1825] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:09.606571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 920/1826] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:09 2022] PUT /identity/v3/projects/a2fad667fcdf479f99f8b8d502b40395/users/1ee653a68f2842b0b8f97aa560697303/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:09.608982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ace3b1-1e20-4375-845b-96423186a06a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.609406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ace3b1-1e20-4375-845b-96423186a06a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.609687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ace3b1-1e20-4375-845b-96423186a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.631588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-36ace3b1-1e20-4375-845b-96423186a06a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:09.633410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-36ace3b1-1e20-4375-845b-96423186a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:09.757818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 907/1827] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:09.783886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b615-0f17-4bb7-b3f4-1577181d9e3a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:09.853523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:09.889018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b615-0f17-4bb7-b3f4-1577181d9e3a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:09.903583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94215d-2539-4eec-804c-a0748b2941ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:09.906941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94215d-2539-4eec-804c-a0748b2941ab service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:09.907393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94215d-2539-4eec-804c-a0748b2941ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:09.909570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94215d-2539-4eec-804c-a0748b2941ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:09.928174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94215d-2539-4eec-804c-a0748b2941ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:09.930252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94215d-2539-4eec-804c-a0748b2941ab service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:09.956695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 921/1828] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:10.028795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ace3b1-1e20-4375-845b-96423186a06a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:10.030290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-36ace3b1-1e20-4375-845b-96423186a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:10.044474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ace3b1-1e20-4375-845b-96423186a06a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:10.051025 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:10.051818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.053052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.053052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] PATH_INFO: `/v3/projects/dff5cb27b65243ceab44a01eaeb73c29` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.053866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff5cb27b65243ceab44a01eaeb73c29)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:10.056212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:10.147425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff5cb27b65243ceab44a01eaeb73c29', 'request_id': 'req-23c64b3f-f513-4f1e-8926-1586a8278e7e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:10.167057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff5cb27b65243ceab44a01eaeb73c29', 'request_id': 'req-23c64b3f-f513-4f1e-8926-1586a8278e7e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:10.174120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:10.176743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff5cb27b65243ceab44a01eaeb73c29', 'request_id': 'req-23c64b3f-f513-4f1e-8926-1586a8278e7e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:10.211759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] The token cache is being invalidate because project dff5cb27b65243ceab44a01eaeb73c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:10.212252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:10.213200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-23c64b3f-f513-4f1e-8926-1586a8278e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:10.218723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 908/1829] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:10 2022] DELETE /identity/v3/projects/dff5cb27b65243ceab44a01eaeb73c29 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:00:10.220870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c0f4-eba9-49b2-918f-74b66ca338a6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.221399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c0f4-eba9-49b2-918f-74b66ca338a6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.221980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c0f4-eba9-49b2-918f-74b66ca338a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.247907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e442c0f4-eba9-49b2-918f-74b66ca338a6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:10.250197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e442c0f4-eba9-49b2-918f-74b66ca338a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:10.358500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 922/1830] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:10.368505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74ae2d-87f2-4e76-8fd4-e054ecbef5c1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.369994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74ae2d-87f2-4e76-8fd4-e054ecbef5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.370286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74ae2d-87f2-4e76-8fd4-e054ecbef5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.397424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1f74ae2d-87f2-4e76-8fd4-e054ecbef5c1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:10.398825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1f74ae2d-87f2-4e76-8fd4-e054ecbef5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:10.409685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 909/1831] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:10.414426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442c0f4-eba9-49b2-918f-74b66ca338a6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:10.425439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442c0f4-eba9-49b2-918f-74b66ca338a6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:10.432231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:10.432848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.433702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.434001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.434712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:00:10.435279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:10.436817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:10.451389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 923/1832] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:00:10.455503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74ae2d-87f2-4e76-8fd4-e054ecbef5c1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:10.465658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74ae2d-87f2-4e76-8fd4-e054ecbef5c1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:10.481508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97802f-3c39-4966-9c3f-1c1efa121a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:10.482243 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97802f-3c39-4966-9c3f-1c1efa121a27 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.482549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97802f-3c39-4966-9c3f-1c1efa121a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.482825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97802f-3c39-4966-9c3f-1c1efa121a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.483508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97802f-3c39-4966-9c3f-1c1efa121a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:10.485437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97802f-3c39-4966-9c3f-1c1efa121a27 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:10.563017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:10.583000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 910/1833] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:10 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:00:10.587791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60892b7-2c4a-4c2e-a1e4-fb1b0b2d9846 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:10.692302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3622a0-6ca0-4741-88fb-49bf1e29d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:10.693190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3622a0-6ca0-4741-88fb-49bf1e29d309 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.693627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3622a0-6ca0-4741-88fb-49bf1e29d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.694051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3622a0-6ca0-4741-88fb-49bf1e29d309 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.694915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3622a0-6ca0-4741-88fb-49bf1e29d309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:10.705220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3622a0-6ca0-4741-88fb-49bf1e29d309 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:10.746075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97802f-3c39-4966-9c3f-1c1efa121a27 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:10.774909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 924/1834] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:10 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:10.777884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97802f-3c39-4966-9c3f-1c1efa121a27 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:10.800153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8317-d67b-456b-b7ab-3f6e6cfbb843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:10.801040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8317-d67b-456b-b7ab-3f6e6cfbb843 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.803151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8317-d67b-456b-b7ab-3f6e6cfbb843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.803286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8317-d67b-456b-b7ab-3f6e6cfbb843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.803933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8317-d67b-456b-b7ab-3f6e6cfbb843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:10.810439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8317-d67b-456b-b7ab-3f6e6cfbb843 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:10.854581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 911/1835] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:10.856739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3622a0-6ca0-4741-88fb-49bf1e29d309 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:10.877131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3622a0-6ca0-4741-88fb-49bf1e29d309 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:10.894317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df3d7f-1dea-4594-a381-2c17edf0c9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:10.895068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3d7f-1dea-4594-a381-2c17edf0c9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.895279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3d7f-1dea-4594-a381-2c17edf0c9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.895533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3d7f-1dea-4594-a381-2c17edf0c9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.899143 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df3d7f-1dea-4594-a381-2c17edf0c9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:10.900725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df3d7f-1dea-4594-a381-2c17edf0c9a3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:10.933458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 925/1836] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:10.937804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8317-d67b-456b-b7ab-3f6e6cfbb843 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:10.954728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8317-d67b-456b-b7ab-3f6e6cfbb843 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:10.967471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:10.968526 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:10.969050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:10.969561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] PATH_INFO: `/v3/projects/998b12e8adc84e9b93b5d2a2fb1a41cd/users/a6574838880045caad7d89348372ff41/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:10.993967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] RBAC: Authorizing `identity:create_grant(project_id=998b12e8adc84e9b93b5d2a2fb1a41cd, user_id=a6574838880045caad7d89348372ff41, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:10.998263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:11.022867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 912/1837] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:10 2022] PUT /identity/v3/projects/998b12e8adc84e9b93b5d2a2fb1a41cd/users/a6574838880045caad7d89348372ff41/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:11.035374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1951-fcd2-4dcb-8888-1cf30fddaef7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:11.035665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1951-fcd2-4dcb-8888-1cf30fddaef7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:11.035951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1951-fcd2-4dcb-8888-1cf30fddaef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:11.079695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-131c1951-fcd2-4dcb-8888-1cf30fddaef7 None None] MFA Rules not processed for user `a6574838880045caad7d89348372ff41`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:11.081544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-131c1951-fcd2-4dcb-8888-1cf30fddaef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:11.141768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:11.218090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 926/1838] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:11.225847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:11.228338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:11.321673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831c99a-579e-4dc4-bc1d-4132c31d563b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:11.328266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610dede-58ce-4f8d-8472-5a7ae6657164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:11.329065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610dede-58ce-4f8d-8472-5a7ae6657164 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:11.329359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610dede-58ce-4f8d-8472-5a7ae6657164 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:11.329759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610dede-58ce-4f8d-8472-5a7ae6657164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:11.343945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610dede-58ce-4f8d-8472-5a7ae6657164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:11.346296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610dede-58ce-4f8d-8472-5a7ae6657164 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:11.375526 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 913/1839] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:11.994293 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1951-fcd2-4dcb-8888-1cf30fddaef7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:11.996464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-131c1951-fcd2-4dcb-8888-1cf30fddaef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:12.114658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1951-fcd2-4dcb-8888-1cf30fddaef7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:12.124464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:12.125148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:12.125992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:12.125992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] PATH_INFO: `/v3/users/baa5415081434296b217c94ed1bfe143` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:12.127321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa5415081434296b217c94ed1bfe143)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:12.129360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:12.212533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa5415081434296b217c94ed1bfe143'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:12.213545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa5415081434296b217c94ed1bfe143'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:12.222208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa5415081434296b217c94ed1bfe143'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:12.241097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa5415081434296b217c94ed1bfe143'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:12.241097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa5415081434296b217c94ed1bfe143'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:12.260697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 927/1840] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:11 2022] DELETE /identity/v3/users/baa5415081434296b217c94ed1bfe143 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:12.265637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd7c8-5108-42bd-9a97-d82160065892 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:12.266160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd7c8-5108-42bd-9a97-d82160065892 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:12.266255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd7c8-5108-42bd-9a97-d82160065892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:12.314916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-492cd7c8-5108-42bd-9a97-d82160065892 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:12.317350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-492cd7c8-5108-42bd-9a97-d82160065892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:12.493995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 914/1841] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:12.508469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:12.510908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:12.618943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037d41d-d7a5-484c-907f-53f4851e1a79 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:12.624452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921058d-aa7e-42e2-ac41-3be27440bca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:12.626098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921058d-aa7e-42e2-ac41-3be27440bca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:12.626673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921058d-aa7e-42e2-ac41-3be27440bca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:12.627323 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921058d-aa7e-42e2-ac41-3be27440bca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:12.645053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921058d-aa7e-42e2-ac41-3be27440bca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:12.648792 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921058d-aa7e-42e2-ac41-3be27440bca0 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:12.656770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:12.667843 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 928/1842] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:13.772906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd7c8-5108-42bd-9a97-d82160065892 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:13.774409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-492cd7c8-5108-42bd-9a97-d82160065892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:13.793847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd7c8-5108-42bd-9a97-d82160065892 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:13.802174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:13.803192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:13.803311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:13.803553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] PATH_INFO: `/v3/projects/3660e036c83f4c25a471dd04b606b8d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:13.819541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3660e036c83f4c25a471dd04b606b8d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:13.822921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:13.868506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:13.927213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3660e036c83f4c25a471dd04b606b8d1', 'request_id': 'req-79201ce0-044d-4c21-a238-4d665b639b06'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:13.936803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3660e036c83f4c25a471dd04b606b8d1', 'request_id': 'req-79201ce0-044d-4c21-a238-4d665b639b06'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:13.945910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3660e036c83f4c25a471dd04b606b8d1', 'request_id': 'req-79201ce0-044d-4c21-a238-4d665b639b06'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:13.985967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] The token cache is being invalidate because project 3660e036c83f4c25a471dd04b606b8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:13.986416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:13.989761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:13.994637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 915/1843] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:13 2022] DELETE /identity/v3/projects/3660e036c83f4c25a471dd04b606b8d1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:14.992439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf765-95f8-441e-b259-1f1e12ad71ba None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:14.993152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf765-95f8-441e-b259-1f1e12ad71ba None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:14.994349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf765-95f8-441e-b259-1f1e12ad71ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:15.096750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5d6cf765-95f8-441e-b259-1f1e12ad71ba None None] MFA Rules not processed for user `05ace9c538754a1cad4a6dc9fc8b7bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:15.098125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5d6cf765-95f8-441e-b259-1f1e12ad71ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:15.265992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 929/1844] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:15.680896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:15.684234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:15.898170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79201ce0-044d-4c21-a238-4d665b639b06 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:15.912720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:15.913358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:15.913638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:15.913912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:15.933299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:15.935360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:15.968056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 916/1845] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:17.935301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a616-cfec-43ea-856e-49ba2e665c89 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:17.935780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a616-cfec-43ea-856e-49ba2e665c89 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:17.936045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a616-cfec-43ea-856e-49ba2e665c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:17.993099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0560a616-cfec-43ea-856e-49ba2e665c89 None None] MFA Rules not processed for user `1ee653a68f2842b0b8f97aa560697303`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:17.994566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0560a616-cfec-43ea-856e-49ba2e665c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:18.073806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 930/1846] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:18.078013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:18.079603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:18.160725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a616-cfec-43ea-856e-49ba2e665c89 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:18.163972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0560a616-cfec-43ea-856e-49ba2e665c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:18.221679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129fdc7-54ad-4d08-b400-5c01da31b584 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:18.228498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a766-52f1-48c3-8a7f-d5e50ab261e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:18.229119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a766-52f1-48c3-8a7f-d5e50ab261e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.229400 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a766-52f1-48c3-8a7f-d5e50ab261e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.230285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a766-52f1-48c3-8a7f-d5e50ab261e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.231539 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a766-52f1-48c3-8a7f-d5e50ab261e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:18.234555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a766-52f1-48c3-8a7f-d5e50ab261e0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:18.262072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a616-cfec-43ea-856e-49ba2e665c89 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:18.266998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 917/1847] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:18 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:18.267135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:18.267691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.267978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.268252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] PATH_INFO: `/v3/users/a6574838880045caad7d89348372ff41` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.268745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d5ef-d1f3-4057-a244-20f8c3fca340 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.269219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d5ef-d1f3-4057-a244-20f8c3fca340 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.269458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6574838880045caad7d89348372ff41)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:18.269735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d5ef-d1f3-4057-a244-20f8c3fca340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.271902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:18.295063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2e49d5ef-d1f3-4057-a244-20f8c3fca340 None None] MFA Rules not processed for user `05ace9c538754a1cad4a6dc9fc8b7bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:18.296594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2e49d5ef-d1f3-4057-a244-20f8c3fca340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:18.300338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:18.316821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:18.350225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6574838880045caad7d89348372ff41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:18.351297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6574838880045caad7d89348372ff41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:18.361110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6574838880045caad7d89348372ff41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:18.381058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6574838880045caad7d89348372ff41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:18.381870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5817bb2e-3878-4f7d-962a-67e245846468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6574838880045caad7d89348372ff41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:18.383010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 918/1848] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:18.384005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49d5ef-d1f3-4057-a244-20f8c3fca340 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:18.415327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 931/1849] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:18 2022] DELETE /identity/v3/users/a6574838880045caad7d89348372ff41 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:18.421622 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e47a1-fced-458d-9c5e-693367a2abd8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.422820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e47a1-fced-458d-9c5e-693367a2abd8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.425251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e47a1-fced-458d-9c5e-693367a2abd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.486399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49d5ef-d1f3-4057-a244-20f8c3fca340 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:18.495978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-169e47a1-fced-458d-9c5e-693367a2abd8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:18.497395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-169e47a1-fced-458d-9c5e-693367a2abd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:18.585785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:18.586907 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.587295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.588456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.590167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:18.593001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:18.632183 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 919/1850] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:18 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:18.636393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:18.640968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:18.650570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 932/1851] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:18.662256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7efb17-feaa-427e-bb8a-92b037405f4b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:18.663893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e47a1-fced-458d-9c5e-693367a2abd8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:18.668933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-169e47a1-fced-458d-9c5e-693367a2abd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:18.671074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfece62-07b1-4b48-b084-7524ef9e1a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:18.671711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfece62-07b1-4b48-b084-7524ef9e1a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.671996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfece62-07b1-4b48-b084-7524ef9e1a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.672272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfece62-07b1-4b48-b084-7524ef9e1a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.672924 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfece62-07b1-4b48-b084-7524ef9e1a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:18.680714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfece62-07b1-4b48-b084-7524ef9e1a29 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:18.705564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 920/1852] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:18.706599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfece62-07b1-4b48-b084-7524ef9e1a29 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:18.717977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfece62-07b1-4b48-b084-7524ef9e1a29 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:18.723560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c094a-31b7-4e93-be77-aa046cf44399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:18.724611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c094a-31b7-4e93-be77-aa046cf44399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.724972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c094a-31b7-4e93-be77-aa046cf44399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.725491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c094a-31b7-4e93-be77-aa046cf44399 admin admin] PATH_INFO: `/v3/projects/ea3a63d14e1e4269a3ba4c496e4a05c6/users/9999211a9d4640aea49f661fe9be738a/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.749797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c094a-31b7-4e93-be77-aa046cf44399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3a63d14e1e4269a3ba4c496e4a05c6, user_id=9999211a9d4640aea49f661fe9be738a, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:18.752488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c094a-31b7-4e93-be77-aa046cf44399 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:18.778450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e47a1-fced-458d-9c5e-693367a2abd8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:18.785135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 921/1853] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:18 2022] PUT /identity/v3/projects/ea3a63d14e1e4269a3ba4c496e4a05c6/users/9999211a9d4640aea49f661fe9be738a/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:18.786187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c094a-31b7-4e93-be77-aa046cf44399 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:18.838085 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:18.862327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e02b9-48ff-4a3c-a965-d15bcfe75e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:18.863075 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e02b9-48ff-4a3c-a965-d15bcfe75e10 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.863968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e02b9-48ff-4a3c-a965-d15bcfe75e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.864723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e02b9-48ff-4a3c-a965-d15bcfe75e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.873425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:18.891023 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c094a-31b7-4e93-be77-aa046cf44399 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:18.907277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb4964-4a12-4a36-b792-279ec55ae1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:18.907908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4964-4a12-4a36-b792-279ec55ae1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.909055 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4964-4a12-4a36-b792-279ec55ae1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.909349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4964-4a12-4a36-b792-279ec55ae1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.910451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb4964-4a12-4a36-b792-279ec55ae1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:18.912619 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb4964-4a12-4a36-b792-279ec55ae1ee admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:18.928362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 922/1854] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:18.932585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb4964-4a12-4a36-b792-279ec55ae1ee admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:18.946661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb4964-4a12-4a36-b792-279ec55ae1ee admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:18.959373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:18.960226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:18.960673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:18.961077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] PATH_INFO: `/v3/projects/ea3a63d14e1e4269a3ba4c496e4a05c6/users/9999211a9d4640aea49f661fe9be738a/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:18.964361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3a63d14e1e4269a3ba4c496e4a05c6, user_id=9999211a9d4640aea49f661fe9be738a, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:18.967303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:19.003438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 923/1855] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:18 2022] PUT /identity/v3/projects/ea3a63d14e1e4269a3ba4c496e4a05c6/users/9999211a9d4640aea49f661fe9be738a/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:19.008960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e02b9-48ff-4a3c-a965-d15bcfe75e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:19.011895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e02b9-48ff-4a3c-a965-d15bcfe75e10 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:19.039076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 933/1856] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:19.647142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:19.650342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:19.832389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464ca28-6757-45fe-83a1-e6029c00a4ae admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:19.862917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:19.863611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:19.863897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:19.864178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] PATH_INFO: `/v3/projects/998b12e8adc84e9b93b5d2a2fb1a41cd` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:19.865477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998b12e8adc84e9b93b5d2a2fb1a41cd)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:19.867841 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:19.976624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998b12e8adc84e9b93b5d2a2fb1a41cd', 'request_id': 'req-12017b54-f6c9-41c1-83cc-78e70188d9f3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:19.986337 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998b12e8adc84e9b93b5d2a2fb1a41cd', 'request_id': 'req-12017b54-f6c9-41c1-83cc-78e70188d9f3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:19.999097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998b12e8adc84e9b93b5d2a2fb1a41cd', 'request_id': 'req-12017b54-f6c9-41c1-83cc-78e70188d9f3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:20.021611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] The token cache is being invalidate because project 998b12e8adc84e9b93b5d2a2fb1a41cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:20.021980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:20.022749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-12017b54-f6c9-41c1-83cc-78e70188d9f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:20.028412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 924/1857] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:19 2022] DELETE /identity/v3/projects/998b12e8adc84e9b93b5d2a2fb1a41cd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:20.031500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd696e-dbf8-4c75-9238-c34f17c56941 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.031945 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd696e-dbf8-4c75-9238-c34f17c56941 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.032236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd696e-dbf8-4c75-9238-c34f17c56941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:20.097042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bbfd696e-dbf8-4c75-9238-c34f17c56941 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:20.109827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bbfd696e-dbf8-4c75-9238-c34f17c56941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:20.230006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 934/1858] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:20.231949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b625e-089a-484e-9587-6da595c5f6b2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.232876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b625e-089a-484e-9587-6da595c5f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.233302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b625e-089a-484e-9587-6da595c5f6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:20.267626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5a4b625e-089a-484e-9587-6da595c5f6b2 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:20.271660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5a4b625e-089a-484e-9587-6da595c5f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:20.303278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 925/1859] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:20.308319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd696e-dbf8-4c75-9238-c34f17c56941 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:20.322422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd696e-dbf8-4c75-9238-c34f17c56941 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:20.336668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:20.337388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.337672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.337948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:20.340174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:00:20.340174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:20.342308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:20.363584 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b625e-089a-484e-9587-6da595c5f6b2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:20.369928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 935/1860] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:00:20.375700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b625e-089a-484e-9587-6da595c5f6b2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:20.381541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e90b4-3eda-47d1-8d75-28ab98bd4c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:20.382397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90b4-3eda-47d1-8d75-28ab98bd4c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.382975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90b4-3eda-47d1-8d75-28ab98bd4c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.383378 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90b4-3eda-47d1-8d75-28ab98bd4c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:20.385063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e90b4-3eda-47d1-8d75-28ab98bd4c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:20.388585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e90b4-3eda-47d1-8d75-28ab98bd4c5d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:20.467082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:20.467483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 926/1861] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:20 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:20.486842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd37f8-716d-497d-bfe3-6427e517e135 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:20.682008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac8095-4b9b-4c05-9ed6-6190b21f4455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:20.683646 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8095-4b9b-4c05-9ed6-6190b21f4455 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.683986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8095-4b9b-4c05-9ed6-6190b21f4455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.684267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac8095-4b9b-4c05-9ed6-6190b21f4455 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:20.684916 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac8095-4b9b-4c05-9ed6-6190b21f4455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:20.690636 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac8095-4b9b-4c05-9ed6-6190b21f4455 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:20.739820 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 936/1862] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:20 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:20.744681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e90b4-3eda-47d1-8d75-28ab98bd4c5d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:20.768677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e90b4-3eda-47d1-8d75-28ab98bd4c5d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:20.802118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0ef90-0f26-4201-bfe7-80cc24224df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:20.803534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ef90-0f26-4201-bfe7-80cc24224df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.804648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ef90-0f26-4201-bfe7-80cc24224df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.807011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ef90-0f26-4201-bfe7-80cc24224df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:20.811052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0ef90-0f26-4201-bfe7-80cc24224df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:20.816929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0ef90-0f26-4201-bfe7-80cc24224df5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:20.830884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:20.847730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac8095-4b9b-4c05-9ed6-6190b21f4455 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:20.848851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 927/1863] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:20.866721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac8095-4b9b-4c05-9ed6-6190b21f4455 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:20.874112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a8610-2097-4551-a022-43f35ee3469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:20.890555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8610-2097-4551-a022-43f35ee3469d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.890555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8610-2097-4551-a022-43f35ee3469d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.890555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a8610-2097-4551-a022-43f35ee3469d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:20.890555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a8610-2097-4551-a022-43f35ee3469d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:20.890555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a8610-2097-4551-a022-43f35ee3469d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:20.893373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 937/1864] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:20.897432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0ef90-0f26-4201-bfe7-80cc24224df5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:20.912065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0ef90-0f26-4201-bfe7-80cc24224df5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:20.917922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:20.919012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.919393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.920372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] PATH_INFO: `/v3/projects/12955a710ddb42889264a18e8e6c7988/users/ccb81c9022684b57854ebb28b3114ccc/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:20.941323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12955a710ddb42889264a18e8e6c7988, user_id=ccb81c9022684b57854ebb28b3114ccc, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:20.944507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:20.994601 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d13fd9-be0e-4c68-b5eb-e1ece3439efc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:20.994711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d13fd9-be0e-4c68-b5eb-e1ece3439efc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:20.995003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d13fd9-be0e-4c68-b5eb-e1ece3439efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:21.001478 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 928/1865] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:20 2022] PUT /identity/v3/projects/12955a710ddb42889264a18e8e6c7988/users/ccb81c9022684b57854ebb28b3114ccc/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:21.052834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a0d13fd9-be0e-4c68-b5eb-e1ece3439efc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:21.060722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a0d13fd9-be0e-4c68-b5eb-e1ece3439efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:21.083105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:21.388289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 938/1866] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:21.432386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:21.435893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:21.651487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6c64-e081-4fe0-ae32-0fc56c613272 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:21.663121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:21.678923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:21.678923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:21.678923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:21.705771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:21.707825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:21.723207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 929/1867] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:24.028680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c298-a42a-4651-9c57-8ad5f4ed48e2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:24.029149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c298-a42a-4651-9c57-8ad5f4ed48e2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:24.029275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c298-a42a-4651-9c57-8ad5f4ed48e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:24.076723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ce43c298-a42a-4651-9c57-8ad5f4ed48e2 None None] MFA Rules not processed for user `ccb81c9022684b57854ebb28b3114ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:24.078762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ce43c298-a42a-4651-9c57-8ad5f4ed48e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:24.256112 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 939/1868] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:24.271481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:24.274742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:24.396016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776dbe-c591-4898-8d53-df7c20080855 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:24.400199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:24.401097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:24.401097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:24.401963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:24.424286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:24.427776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:24.465898 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 930/1869] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:26.312090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f264-7116-441e-8cd7-ec4f9cc41c3a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:26.313575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f264-7116-441e-8cd7-ec4f9cc41c3a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:26.314018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f264-7116-441e-8cd7-ec4f9cc41c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:26.358962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-eb33f264-7116-441e-8cd7-ec4f9cc41c3a None None] MFA Rules not processed for user `ccb81c9022684b57854ebb28b3114ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:26.360208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eb33f264-7116-441e-8cd7-ec4f9cc41c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:26.392440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 940/1870] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:27.706371 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:27.708115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:27.730190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a9029-7041-4f7e-811e-11cc3afaa09d service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:27.744793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:27.745541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:27.745826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:27.746105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:27.748014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:27.759031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503194-2c02-4540-8713-a73ac63609c9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:27.759456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503194-2c02-4540-8713-a73ac63609c9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:27.759577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503194-2c02-4540-8713-a73ac63609c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:27.803652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-67503194-2c02-4540-8713-a73ac63609c9 None None] MFA Rules not processed for user `9999211a9d4640aea49f661fe9be738a`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:27.808582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67503194-2c02-4540-8713-a73ac63609c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:27.848113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:27.850142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:27.864190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 931/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:27.914917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 941/1872] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:27.925195 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:27.926651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:27.966799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:28.049045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4461cc-9111-44b5-b5c3-3b9cc663b4e3 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:28.055811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91a62-318a-4160-947f-32508acf1b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:28.056918 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91a62-318a-4160-947f-32508acf1b3d service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:28.056918 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91a62-318a-4160-947f-32508acf1b3d service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:28.057092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91a62-318a-4160-947f-32508acf1b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:28.059561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a9c91a62-318a-4160-947f-32508acf1b3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:28.139831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91a62-318a-4160-947f-32508acf1b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:28.142010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91a62-318a-4160-947f-32508acf1b3d service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:28.153451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 932/1873] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:29.639463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0702-cbfc-4e72-b1c6-c266ef22f033 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:29.640042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0702-cbfc-4e72-b1c6-c266ef22f033 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:29.640143 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0702-cbfc-4e72-b1c6-c266ef22f033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:29.659711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-461f0702-cbfc-4e72-b1c6-c266ef22f033 None None] MFA Rules not processed for user `1ee653a68f2842b0b8f97aa560697303`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:29.660931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-461f0702-cbfc-4e72-b1c6-c266ef22f033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:29.668048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 942/1874] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:38.148031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=49 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:39.654145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:46.874268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde640-71f8-4b4c-819b-aa95077b22ba None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:46.874759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde640-71f8-4b4c-819b-aa95077b22ba None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:46.874851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde640-71f8-4b4c-819b-aa95077b22ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:46.896353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-68dde640-71f8-4b4c-819b-aa95077b22ba None None] MFA Rules not processed for user `ccb81c9022684b57854ebb28b3114ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:46.897564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-68dde640-71f8-4b4c-819b-aa95077b22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:46.905200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 933/1875] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:49.088543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d7947-6217-4010-a8d9-9bcffe647305 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:49.089045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d7947-6217-4010-a8d9-9bcffe647305 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:49.089138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d7947-6217-4010-a8d9-9bcffe647305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:49.108721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-098d7947-6217-4010-a8d9-9bcffe647305 None None] MFA Rules not processed for user `9d51c7335010488d8a2bdc329f975dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:49.110066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-098d7947-6217-4010-a8d9-9bcffe647305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:49.165045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 943/1876] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:52.320158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dde640-71f8-4b4c-819b-aa95077b22ba None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:52.321744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-68dde640-71f8-4b4c-819b-aa95077b22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:52.341347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dde640-71f8-4b4c-819b-aa95077b22ba None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:52.347902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:52.348838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:52.349276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:52.349806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] PATH_INFO: `/v3/users/bef8a63e184a472a85775a1e56127c31` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:52.351265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef8a63e184a472a85775a1e56127c31)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:52.354512 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:52.412334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef8a63e184a472a85775a1e56127c31'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:52.448106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef8a63e184a472a85775a1e56127c31'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:52.459270 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef8a63e184a472a85775a1e56127c31'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:52.460215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef8a63e184a472a85775a1e56127c31'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:52.470449 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef8a63e184a472a85775a1e56127c31'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:52.478662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 934/1877] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:52 2022] DELETE /identity/v3/users/bef8a63e184a472a85775a1e56127c31 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:53.023574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d7947-6217-4010-a8d9-9bcffe647305 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:53.067772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d7947-6217-4010-a8d9-9bcffe647305 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:53.161876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:53.162872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:53.163421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:53.164032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] PATH_INFO: `/v3/projects/d588b398d8d14cec8536a7e647b25114` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:53.166634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d588b398d8d14cec8536a7e647b25114)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:53.169485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:53.226155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd588b398d8d14cec8536a7e647b25114', 'request_id': 'req-f7b6089b-dacc-4747-908e-0076e195a1ae'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.234052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd588b398d8d14cec8536a7e647b25114', 'request_id': 'req-f7b6089b-dacc-4747-908e-0076e195a1ae'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.240993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd588b398d8d14cec8536a7e647b25114', 'request_id': 'req-f7b6089b-dacc-4747-908e-0076e195a1ae'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.257901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] The token cache is being invalidate because project d588b398d8d14cec8536a7e647b25114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:53.258533 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.259491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.261180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 944/1878] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:53 2022] DELETE /identity/v3/projects/d588b398d8d14cec8536a7e647b25114 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:53.266368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:53.269142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:53.289699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c26d50-560c-498e-aae5-1d9114039f04 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:53.380455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:53.382794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:53.383064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:53.383345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] PATH_INFO: `/v3/users/7b63b149521240b7a7dbe92a2a4dc29c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:53.384737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b63b149521240b7a7dbe92a2a4dc29c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:53.388316 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:53.467145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b63b149521240b7a7dbe92a2a4dc29c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.491093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b63b149521240b7a7dbe92a2a4dc29c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.495142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:53.510027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b63b149521240b7a7dbe92a2a4dc29c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.512494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b63b149521240b7a7dbe92a2a4dc29c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.529312 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ebaa40a6-27fa-4d77-8991-29d99aac34be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b63b149521240b7a7dbe92a2a4dc29c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:53.537693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 935/1879] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:53 2022] DELETE /identity/v3/users/7b63b149521240b7a7dbe92a2a4dc29c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:54.050919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:54.052844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:54.067416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6089b-dacc-4747-908e-0076e195a1ae admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:54.124425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:54.184766 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:54.185679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.186059 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.186560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] PATH_INFO: `/v3/projects/dc7a9014e7114391a0b294421febf79d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.187773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7a9014e7114391a0b294421febf79d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:54.190130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:54.258266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7a9014e7114391a0b294421febf79d', 'request_id': 'req-bf2950df-91d4-42ec-83ec-b6b7018dbb80'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:54.266152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7a9014e7114391a0b294421febf79d', 'request_id': 'req-bf2950df-91d4-42ec-83ec-b6b7018dbb80'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:54.272966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7a9014e7114391a0b294421febf79d', 'request_id': 'req-bf2950df-91d4-42ec-83ec-b6b7018dbb80'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:54.293620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] The token cache is being invalidate because project dc7a9014e7114391a0b294421febf79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:54.293620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:54.294413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bf2950df-91d4-42ec-83ec-b6b7018dbb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:54.301219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 945/1880] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:54 2022] DELETE /identity/v3/projects/dc7a9014e7114391a0b294421febf79d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:54.312359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388dc5-acdc-416e-b556-9254ca2f3b69 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.312652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388dc5-acdc-416e-b556-9254ca2f3b69 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.313810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388dc5-acdc-416e-b556-9254ca2f3b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.334349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c1388dc5-acdc-416e-b556-9254ca2f3b69 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:54.335658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c1388dc5-acdc-416e-b556-9254ca2f3b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:54.406071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 936/1881] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:54.414513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7e9ac-4796-48a3-ad89-c89189fc12d2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.414969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7e9ac-4796-48a3-ad89-c89189fc12d2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.415350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7e9ac-4796-48a3-ad89-c89189fc12d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.439103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-02a7e9ac-4796-48a3-ad89-c89189fc12d2 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:54.440463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-02a7e9ac-4796-48a3-ad89-c89189fc12d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:54.453033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 946/1882] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:54.456888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388dc5-acdc-416e-b556-9254ca2f3b69 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:54.466745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388dc5-acdc-416e-b556-9254ca2f3b69 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:54.471419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:54.472024 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.472301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.472750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.473408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:00:54.473707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:54.475401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:54.488252 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 937/1883] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:00:54.492386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7e9ac-4796-48a3-ad89-c89189fc12d2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:54.502117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7e9ac-4796-48a3-ad89-c89189fc12d2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:54.507894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dca9b-22fd-4f02-bc48-602b5629cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:54.508663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dca9b-22fd-4f02-bc48-602b5629cbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.509046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dca9b-22fd-4f02-bc48-602b5629cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.509423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dca9b-22fd-4f02-bc48-602b5629cbc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.510175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dca9b-22fd-4f02-bc48-602b5629cbc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:54.513551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dca9b-22fd-4f02-bc48-602b5629cbc7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:54.553211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 947/1884] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:54 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:54.566858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:54.578783 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9960129-2328-48e8-9964-5b5b846b0395 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:54.638504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741c94-fc23-4bae-8726-c3c49db25bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:54.639190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741c94-fc23-4bae-8726-c3c49db25bae admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.639541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741c94-fc23-4bae-8726-c3c49db25bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.639870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741c94-fc23-4bae-8726-c3c49db25bae admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.640561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741c94-fc23-4bae-8726-c3c49db25bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:54.642762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741c94-fc23-4bae-8726-c3c49db25bae admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:54.676602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 938/1885] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:54 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:54.677927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dca9b-22fd-4f02-bc48-602b5629cbc7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:54.689431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dca9b-22fd-4f02-bc48-602b5629cbc7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:54.694128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955403f4-40eb-454a-8417-f5806ec8dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:54.694769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955403f4-40eb-454a-8417-f5806ec8dba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.695050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955403f4-40eb-454a-8417-f5806ec8dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.695322 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955403f4-40eb-454a-8417-f5806ec8dba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.696053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955403f4-40eb-454a-8417-f5806ec8dba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:54.697635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955403f4-40eb-454a-8417-f5806ec8dba9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:54.708554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 948/1886] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:54.712561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741c94-fc23-4bae-8726-c3c49db25bae admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:54.723172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741c94-fc23-4bae-8726-c3c49db25bae admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:54.727730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67473d-5026-4d74-b0cb-bf65b3d2a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:54.728328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67473d-5026-4d74-b0cb-bf65b3d2a575 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.728607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67473d-5026-4d74-b0cb-bf65b3d2a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.728878 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67473d-5026-4d74-b0cb-bf65b3d2a575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.729513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67473d-5026-4d74-b0cb-bf65b3d2a575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:54.731595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67473d-5026-4d74-b0cb-bf65b3d2a575 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:54.742169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 939/1887] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:54.746841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955403f4-40eb-454a-8417-f5806ec8dba9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:54.756803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955403f4-40eb-454a-8417-f5806ec8dba9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:54.762299 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:54.762979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.763262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.763537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] PATH_INFO: `/v3/projects/a8c7c9568c2b42119f427d7949719678/users/ae69f31f61a14ff5b41838c733bf7dd1/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.778026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c7c9568c2b42119f427d7949719678, user_id=ae69f31f61a14ff5b41838c733bf7dd1, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:54.780729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:54.794007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 949/1888] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:54 2022] PUT /identity/v3/projects/a8c7c9568c2b42119f427d7949719678/users/ae69f31f61a14ff5b41838c733bf7dd1/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:54.805119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aca72-ab3a-4a55-aca8-a4ce3dbbf4b6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.805402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aca72-ab3a-4a55-aca8-a4ce3dbbf4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.805673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aca72-ab3a-4a55-aca8-a4ce3dbbf4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.833452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-255aca72-ab3a-4a55-aca8-a4ce3dbbf4b6 None None] MFA Rules not processed for user `ae69f31f61a14ff5b41838c733bf7dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:54.834663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-255aca72-ab3a-4a55-aca8-a4ce3dbbf4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:54.872994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:54.900003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 940/1889] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:54.911155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:54.912864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:54.969891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499811-bfa5-4c04-b7d5-a33714390d9b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:54.973429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5b65-1cff-4936-ac86-42f35f15b04d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:54.974027 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5b65-1cff-4936-ac86-42f35f15b04d service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:54.974302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5b65-1cff-4936-ac86-42f35f15b04d service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:54.974608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5b65-1cff-4936-ac86-42f35f15b04d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:54.983102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b5b65-1cff-4936-ac86-42f35f15b04d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:54.984536 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b5b65-1cff-4936-ac86-42f35f15b04d service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:54.993445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 950/1890] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:58.405771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aca72-ab3a-4a55-aca8-a4ce3dbbf4b6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:58.484767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aca72-ab3a-4a55-aca8-a4ce3dbbf4b6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:58.489858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:58.491208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:58.491208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:58.491419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] PATH_INFO: `/v3/users/ae69f31f61a14ff5b41838c733bf7dd1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:58.492895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae69f31f61a14ff5b41838c733bf7dd1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:58.495021 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:58.565489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae69f31f61a14ff5b41838c733bf7dd1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:58.587697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae69f31f61a14ff5b41838c733bf7dd1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:58.598251 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae69f31f61a14ff5b41838c733bf7dd1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:58.599035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae69f31f61a14ff5b41838c733bf7dd1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:58.620093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae69f31f61a14ff5b41838c733bf7dd1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:58.634649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 941/1891] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:00:58 2022] DELETE /identity/v3/users/ae69f31f61a14ff5b41838c733bf7dd1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:58.637605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecaad0-7e7c-4eee-831c-da7d38da9992 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:58.638091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecaad0-7e7c-4eee-831c-da7d38da9992 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:58.638189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecaad0-7e7c-4eee-831c-da7d38da9992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:58.650871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:58.669818 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-22ecaad0-7e7c-4eee-831c-da7d38da9992 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:58.675254 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22ecaad0-7e7c-4eee-831c-da7d38da9992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:58.749359 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 951/1892] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:58.765309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:58.772259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:58.869957 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e8826-4bb8-4c69-9f8a-4b75765e5f1e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:58.874747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e7d35-0b81-4c7a-8434-cf05c60aef41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:58.875387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7d35-0b81-4c7a-8434-cf05c60aef41 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:58.876362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7d35-0b81-4c7a-8434-cf05c60aef41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:58.876851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7d35-0b81-4c7a-8434-cf05c60aef41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:58.904046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7d35-0b81-4c7a-8434-cf05c60aef41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:58.906444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7d35-0b81-4c7a-8434-cf05c60aef41 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:58.919216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 942/1893] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:00:59.275341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecaad0-7e7c-4eee-831c-da7d38da9992 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:59.277759 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22ecaad0-7e7c-4eee-831c-da7d38da9992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:59.299024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecaad0-7e7c-4eee-831c-da7d38da9992 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:59.303765 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:59.304414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.304910 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.305192 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] PATH_INFO: `/v3/projects/a8c7c9568c2b42119f427d7949719678` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.306345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c7c9568c2b42119f427d7949719678)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:59.309590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:59.384091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c7c9568c2b42119f427d7949719678', 'request_id': 'req-5ce9a833-4935-41c9-9041-a06804ad5337'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:59.391924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c7c9568c2b42119f427d7949719678', 'request_id': 'req-5ce9a833-4935-41c9-9041-a06804ad5337'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:59.399120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c7c9568c2b42119f427d7949719678', 'request_id': 'req-5ce9a833-4935-41c9-9041-a06804ad5337'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:59.416887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] The token cache is being invalidate because project a8c7c9568c2b42119f427d7949719678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:00:59.417854 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:59.418619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5ce9a833-4935-41c9-9041-a06804ad5337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:00:59.425913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 952/1894] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:00:59 2022] DELETE /identity/v3/projects/a8c7c9568c2b42119f427d7949719678 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:59.427543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5498e2f-45e6-40db-973d-9401def04afd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.428061 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5498e2f-45e6-40db-973d-9401def04afd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.428061 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5498e2f-45e6-40db-973d-9401def04afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.440645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:00:59.457928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c5498e2f-45e6-40db-973d-9401def04afd None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:59.459880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c5498e2f-45e6-40db-973d-9401def04afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:59.531335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 943/1895] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:00:59.539155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b597-98ee-4a75-bb60-79acf7d0064b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.539453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b597-98ee-4a75-bb60-79acf7d0064b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.539735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b597-98ee-4a75-bb60-79acf7d0064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.560654 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6d68b597-98ee-4a75-bb60-79acf7d0064b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:59.561878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6d68b597-98ee-4a75-bb60-79acf7d0064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:00:59.570722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 953/1896] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:00:59.575027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5498e2f-45e6-40db-973d-9401def04afd None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:59.587231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5498e2f-45e6-40db-973d-9401def04afd None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:59.593091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:59.593607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.593880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.594153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.594891 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:00:59.595187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:59.596887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:59.612177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 944/1897] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:00:59.617008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b597-98ee-4a75-bb60-79acf7d0064b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:59.627123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b597-98ee-4a75-bb60-79acf7d0064b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:59.633203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510244-10f7-4724-a201-486f3cb717ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:59.633819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510244-10f7-4724-a201-486f3cb717ad admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.634146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510244-10f7-4724-a201-486f3cb717ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.634355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510244-10f7-4724-a201-486f3cb717ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.635036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3510244-10f7-4724-a201-486f3cb717ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:59.636958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3510244-10f7-4724-a201-486f3cb717ad admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:59.671581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 954/1898] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:00:59 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:59.675781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:59.687867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc13d6-35be-4256-82e0-42920693e82f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:59.753880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9b3f0-ca41-4133-80e3-39cad1449f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:59.754495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9b3f0-ca41-4133-80e3-39cad1449f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.754873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9b3f0-ca41-4133-80e3-39cad1449f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.755590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9b3f0-ca41-4133-80e3-39cad1449f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.755809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9b3f0-ca41-4133-80e3-39cad1449f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:59.757808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9b3f0-ca41-4133-80e3-39cad1449f8b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:59.780729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 945/1899] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:00:59 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:00:59.784732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510244-10f7-4724-a201-486f3cb717ad admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:59.796160 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510244-10f7-4724-a201-486f3cb717ad admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:59.801173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436257ea-e860-41ce-a6b1-b94360c70252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:59.801782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436257ea-e860-41ce-a6b1-b94360c70252 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.802255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436257ea-e860-41ce-a6b1-b94360c70252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.802831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436257ea-e860-41ce-a6b1-b94360c70252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.803728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436257ea-e860-41ce-a6b1-b94360c70252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:59.805469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436257ea-e860-41ce-a6b1-b94360c70252 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:59.817735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 955/1900] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:59.821372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9b3f0-ca41-4133-80e3-39cad1449f8b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:59.832315 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9b3f0-ca41-4133-80e3-39cad1449f8b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:59.837572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe23c-9810-451b-b5a1-b1705689e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:59.838179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe23c-9810-451b-b5a1-b1705689e5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.838945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe23c-9810-451b-b5a1-b1705689e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.838945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe23c-9810-451b-b5a1-b1705689e5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.839734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffe23c-9810-451b-b5a1-b1705689e5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:59.841464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffe23c-9810-451b-b5a1-b1705689e5e6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:59.853850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 946/1901] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:00:59.858556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436257ea-e860-41ce-a6b1-b94360c70252 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:00:59.870012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436257ea-e860-41ce-a6b1-b94360c70252 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:00:59.876304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:00:59.876965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.877448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.877719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] PATH_INFO: `/v3/projects/cc5de6576b1440e6a5d00aa2ddc4dc7e/users/15f862344faf43e2a8a683bae2775404/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.896289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5de6576b1440e6a5d00aa2ddc4dc7e, user_id=15f862344faf43e2a8a683bae2775404, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:00:59.898987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:00:59.918608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 956/1902] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:00:59 2022] PUT /identity/v3/projects/cc5de6576b1440e6a5d00aa2ddc4dc7e/users/15f862344faf43e2a8a683bae2775404/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:00:59.926821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b42a1-073b-4886-8b05-7a997efeba39 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:00:59.927111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b42a1-073b-4886-8b05-7a997efeba39 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:00:59.927386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b42a1-073b-4886-8b05-7a997efeba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:00:59.960317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0a5b42a1-073b-4886-8b05-7a997efeba39 None None] MFA Rules not processed for user `15f862344faf43e2a8a683bae2775404`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:00:59.975715 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0a5b42a1-073b-4886-8b05-7a997efeba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:00.057734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:00.066654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 947/1903] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:00.078296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:00.080402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:00.115904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:00.158398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da825550-10b8-4683-9f7f-fb42d940cb4b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:00.162330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dfc97-1d12-4cf2-8397-43414685733f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:00.163020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dfc97-1d12-4cf2-8397-43414685733f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:00.163334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dfc97-1d12-4cf2-8397-43414685733f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:00.164420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dfc97-1d12-4cf2-8397-43414685733f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:00.173859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6dfc97-1d12-4cf2-8397-43414685733f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:00.175840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6dfc97-1d12-4cf2-8397-43414685733f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:00.186785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 957/1904] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:01:00.533047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff695c-1899-4fff-871b-dfe2b36413c0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:00.533556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff695c-1899-4fff-871b-dfe2b36413c0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:00.533556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff695c-1899-4fff-871b-dfe2b36413c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:00.554219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-59ff695c-1899-4fff-871b-dfe2b36413c0 None None] MFA Rules not processed for user `4e66774737b5439d8b615cbb271f1faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:00.555655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-59ff695c-1899-4fff-871b-dfe2b36413c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:00.694791 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 948/1905] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:10.181439 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=15 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:10.687110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=26 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:11.043066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d2bf-5e5f-4455-b40e-f22c43b318b1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:11.043354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d2bf-5e5f-4455-b40e-f22c43b318b1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:11.043630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d2bf-5e5f-4455-b40e-f22c43b318b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:11.067338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7c42d2bf-5e5f-4455-b40e-f22c43b318b1 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:11.068893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7c42d2bf-5e5f-4455-b40e-f22c43b318b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:11.146808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 958/1906] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:01:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:11.238433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff695c-1899-4fff-871b-dfe2b36413c0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:11.240123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-59ff695c-1899-4fff-871b-dfe2b36413c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:11.361946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff695c-1899-4fff-871b-dfe2b36413c0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:11.367713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1a7cc-39f9-4350-80d6-4bf46881202f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:11.368381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1a7cc-39f9-4350-80d6-4bf46881202f service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:11.368664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1a7cc-39f9-4350-80d6-4bf46881202f service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:11.369130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1a7cc-39f9-4350-80d6-4bf46881202f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:11.383957 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1a7cc-39f9-4350-80d6-4bf46881202f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:11.394546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1a7cc-39f9-4350-80d6-4bf46881202f service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:11.399559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 949/1907] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:01:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:01:13.678643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42d2bf-5e5f-4455-b40e-f22c43b318b1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:13.680863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7c42d2bf-5e5f-4455-b40e-f22c43b318b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:13.804401 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42d2bf-5e5f-4455-b40e-f22c43b318b1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:13.809088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:13.809780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:13.813355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:13.813355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:13.813355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:13.900056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:13.900056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:13.913907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 959/1908] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:21.390991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=32 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:23.904926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=75 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:24.383945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58876b-9bc4-47f6-ae19-69e5065a63d7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:24.384473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58876b-9bc4-47f6-ae19-69e5065a63d7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:24.384563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58876b-9bc4-47f6-ae19-69e5065a63d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:24.411216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ce58876b-9bc4-47f6-ae19-69e5065a63d7 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:24.412531 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ce58876b-9bc4-47f6-ae19-69e5065a63d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:24.420447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 950/1909] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:01:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:24.434412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:24.445448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6b27-9996-47d4-b4f8-e56500db995b service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:24.451158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219c8fe-f2ef-4377-aad1-2b0e6503731d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:24.451824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c8fe-f2ef-4377-aad1-2b0e6503731d service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:24.452157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c8fe-f2ef-4377-aad1-2b0e6503731d service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:24.452366 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c8fe-f2ef-4377-aad1-2b0e6503731d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:24.460903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219c8fe-f2ef-4377-aad1-2b0e6503731d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:24.462573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219c8fe-f2ef-4377-aad1-2b0e6503731d service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:24.471349 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 960/1910] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:01:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:01:28.437647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0aa9-3248-4b30-8d19-754e4dc8cd89 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:28.438245 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0aa9-3248-4b30-8d19-754e4dc8cd89 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:28.438744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c0aa9-3248-4b30-8d19-754e4dc8cd89 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:28.439947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 951/1911] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 17:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 17:01:28.446006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501877-0b18-46a4-85bc-c5824f5a4db1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:28.446491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501877-0b18-46a4-85bc-c5824f5a4db1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:28.446893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501877-0b18-46a4-85bc-c5824f5a4db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:28.474565 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-77501877-0b18-46a4-85bc-c5824f5a4db1 None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:28.475942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-77501877-0b18-46a4-85bc-c5824f5a4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:28.575658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 961/1912] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 17:01:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:01:28.593689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c0aa9-3248-4b30-8d19-754e4dc8cd89 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:28.595615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-572c0aa9-3248-4b30-8d19-754e4dc8cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:28.699151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c0aa9-3248-4b30-8d19-754e4dc8cd89 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:28.703231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65e98-ec13-4e14-97dc-4029011f037d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ede14ff816494505b20faba615bc5026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:28.704682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65e98-ec13-4e14-97dc-4029011f037d service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:28.704973 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65e98-ec13-4e14-97dc-4029011f037d service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:28.705251 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65e98-ec13-4e14-97dc-4029011f037d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:28.716716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b65e98-ec13-4e14-97dc-4029011f037d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:28.718158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b65e98-ec13-4e14-97dc-4029011f037d service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:28.729495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 952/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:28.809918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fdcd8-f099-453c-8144-697569a57af5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:28.810213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fdcd8-f099-453c-8144-697569a57af5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:28.810494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fdcd8-f099-453c-8144-697569a57af5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:28.811892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 962/1914] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 17:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 17:01:28.817134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641f32-37e8-4f5d-b20a-08c6ac5cfbe4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:28.817622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641f32-37e8-4f5d-b20a-08c6ac5cfbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:28.818060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641f32-37e8-4f5d-b20a-08c6ac5cfbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:28.842276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5f641f32-37e8-4f5d-b20a-08c6ac5cfbe4 None None] MFA Rules not processed for user `b3d805106909465abd09c0daf5ecc1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:28.843615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5f641f32-37e8-4f5d-b20a-08c6ac5cfbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:28.850130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 953/1915] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 17:01:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:28.862456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fdcd8-f099-453c-8144-697569a57af5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:28.874551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fdcd8-f099-453c-8144-697569a57af5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:28.878219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1f24c-28ae-423b-abe2-3b700053cc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:28.878841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f24c-28ae-423b-abe2-3b700053cc31 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:28.879329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f24c-28ae-423b-abe2-3b700053cc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:28.879603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f24c-28ae-423b-abe2-3b700053cc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:28.888224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1f24c-28ae-423b-abe2-3b700053cc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:28.889874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1f24c-28ae-423b-abe2-3b700053cc31 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:28.903887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 963/1916] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:29.022619 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3f85-f170-4172-b9bc-3a51d59eda02 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:29.022993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3f85-f170-4172-b9bc-3a51d59eda02 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:29.023696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3f85-f170-4172-b9bc-3a51d59eda02 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:29.026104 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 954/1917] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 17:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 17:01:29.036391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42401-846a-4fe8-a137-e3ee11ef22e9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:29.036679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42401-846a-4fe8-a137-e3ee11ef22e9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:29.036960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42401-846a-4fe8-a137-e3ee11ef22e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:29.059929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3eb42401-846a-4fe8-a137-e3ee11ef22e9 None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:29.061375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3eb42401-846a-4fe8-a137-e3ee11ef22e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:29.076078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 964/1918] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 17:01:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:29.087428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3f85-f170-4172-b9bc-3a51d59eda02 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:29.100396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3f85-f170-4172-b9bc-3a51d59eda02 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:29.103867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2481d2-a529-401e-8219-57b81f9bfc64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:29.104469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2481d2-a529-401e-8219-57b81f9bfc64 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:29.104744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2481d2-a529-401e-8219-57b81f9bfc64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:29.105992 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2481d2-a529-401e-8219-57b81f9bfc64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:29.119625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2481d2-a529-401e-8219-57b81f9bfc64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:29.121299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2481d2-a529-401e-8219-57b81f9bfc64 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:29.134586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 955/1919] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:32.821010 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb677e-6901-44d6-8095-9670f0e371e6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:32.821536 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb677e-6901-44d6-8095-9670f0e371e6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:32.821627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb677e-6901-44d6-8095-9670f0e371e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:32.844316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e5fb677e-6901-44d6-8095-9670f0e371e6 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:32.845756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e5fb677e-6901-44d6-8095-9670f0e371e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:32.853183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 965/1920] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:01:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:32.869502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2481d2-a529-401e-8219-57b81f9bfc64 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:32.885193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2481d2-a529-401e-8219-57b81f9bfc64 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:32.891008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1896d-b9b2-42f5-8531-6a95b71b0ef5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:32.891612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1896d-b9b2-42f5-8531-6a95b71b0ef5 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:32.891885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1896d-b9b2-42f5-8531-6a95b71b0ef5 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:32.892153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1896d-b9b2-42f5-8531-6a95b71b0ef5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:32.908737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1896d-b9b2-42f5-8531-6a95b71b0ef5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:32.910677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1896d-b9b2-42f5-8531-6a95b71b0ef5 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:32.920197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 956/1921] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:01:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:01:36.094122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb677e-6901-44d6-8095-9670f0e371e6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:36.219326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb677e-6901-44d6-8095-9670f0e371e6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:36.224385 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:36.225176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:36.225566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:36.226088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] PATH_INFO: `/v3/users/15f862344faf43e2a8a683bae2775404` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:36.227518 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f862344faf43e2a8a683bae2775404)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:36.230767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:36.329083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f862344faf43e2a8a683bae2775404'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:36.330237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f862344faf43e2a8a683bae2775404'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:36.347346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:36.362292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f862344faf43e2a8a683bae2775404'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:36.385045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f862344faf43e2a8a683bae2775404'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:36.385862 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f862344faf43e2a8a683bae2775404'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:36.417621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 966/1922] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:01:36 2022] DELETE /identity/v3/users/15f862344faf43e2a8a683bae2775404 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:01:36.421990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526da3-5121-4f05-ba8c-bcdbac1b655d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:36.422553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526da3-5121-4f05-ba8c-bcdbac1b655d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:36.422553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526da3-5121-4f05-ba8c-bcdbac1b655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:36.459021 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-21526da3-5121-4f05-ba8c-bcdbac1b655d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:36.460660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-21526da3-5121-4f05-ba8c-bcdbac1b655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:36.573078 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 957/1923] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:36.585030 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:36.588852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:36.694944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2969-001b-441c-8ee4-40862ee79766 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:36.700094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b47d6-decb-4737-8c62-d61488469173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:36.700745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b47d6-decb-4737-8c62-d61488469173 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:36.701018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b47d6-decb-4737-8c62-d61488469173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:36.701300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b47d6-decb-4737-8c62-d61488469173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:36.719218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b47d6-decb-4737-8c62-d61488469173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:36.720997 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b47d6-decb-4737-8c62-d61488469173 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:36.734888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 967/1924] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:01:37.166080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21526da3-5121-4f05-ba8c-bcdbac1b655d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:37.173818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-21526da3-5121-4f05-ba8c-bcdbac1b655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:37.220469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21526da3-5121-4f05-ba8c-bcdbac1b655d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:37.240747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:37.241725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:37.242111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:37.242390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] PATH_INFO: `/v3/projects/cc5de6576b1440e6a5d00aa2ddc4dc7e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:37.245686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5de6576b1440e6a5d00aa2ddc4dc7e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:37.253986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:37.360403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5de6576b1440e6a5d00aa2ddc4dc7e', 'request_id': 'req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:37.375354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5de6576b1440e6a5d00aa2ddc4dc7e', 'request_id': 'req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:37.380113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:37.384125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5de6576b1440e6a5d00aa2ddc4dc7e', 'request_id': 'req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:37.413654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] The token cache is being invalidate because project cc5de6576b1440e6a5d00aa2ddc4dc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:01:37.413860 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:37.414784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1a30e31c-44c0-4c95-945d-9b81a1b0ca02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:37.417661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 958/1925] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:01:37 2022] DELETE /identity/v3/projects/cc5de6576b1440e6a5d00aa2ddc4dc7e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:01:37.422853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02b01c-3258-4681-9c9c-bed4b5ac82ad None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:37.423850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02b01c-3258-4681-9c9c-bed4b5ac82ad None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:37.424333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02b01c-3258-4681-9c9c-bed4b5ac82ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:37.468720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2e02b01c-3258-4681-9c9c-bed4b5ac82ad None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:37.471411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2e02b01c-3258-4681-9c9c-bed4b5ac82ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:37.610630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 968/1926] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:37.610985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6564c9-413b-4027-b20d-213794679ae7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:37.610985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6564c9-413b-4027-b20d-213794679ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:37.610985 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6564c9-413b-4027-b20d-213794679ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:37.638352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5c6564c9-413b-4027-b20d-213794679ae7 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:37.639626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5c6564c9-413b-4027-b20d-213794679ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:37.651079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 959/1927] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:37.653554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02b01c-3258-4681-9c9c-bed4b5ac82ad None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:37.665487 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02b01c-3258-4681-9c9c-bed4b5ac82ad None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:37.672490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:37.673271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:37.673651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:37.674028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:37.674837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:01:37.675256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:37.677043 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:37.739323 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 969/1928] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:01:37.740850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6564c9-413b-4027-b20d-213794679ae7 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:37.752240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6564c9-413b-4027-b20d-213794679ae7 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:37.757481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f90a4-723e-4f84-a0d7-3acf21e9b9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:37.758501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f90a4-723e-4f84-a0d7-3acf21e9b9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:37.759019 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f90a4-723e-4f84-a0d7-3acf21e9b9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:37.759391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f90a4-723e-4f84-a0d7-3acf21e9b9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:37.760131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f90a4-723e-4f84-a0d7-3acf21e9b9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:37.763089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f90a4-723e-4f84-a0d7-3acf21e9b9d0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:37.810682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 960/1929] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:01:37 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:01:37.811838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:37.827096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75cdf3-66f5-4529-8e78-0b7fd59b3c9d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:37.944177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542f75-1b16-4f69-a039-1d753ed24586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:37.944944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542f75-1b16-4f69-a039-1d753ed24586 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:37.945318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542f75-1b16-4f69-a039-1d753ed24586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:37.945691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542f75-1b16-4f69-a039-1d753ed24586 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:37.946456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b542f75-1b16-4f69-a039-1d753ed24586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:37.955756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b542f75-1b16-4f69-a039-1d753ed24586 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:37.968565 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:37.997974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 970/1930] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:01:37 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:01:38.001932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f90a4-723e-4f84-a0d7-3acf21e9b9d0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:38.024355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f90a4-723e-4f84-a0d7-3acf21e9b9d0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:38.033207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b8fc3-65d1-4774-8def-a067c1f1ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:38.034439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b8fc3-65d1-4774-8def-a067c1f1ea6c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:38.035036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b8fc3-65d1-4774-8def-a067c1f1ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:38.035644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b8fc3-65d1-4774-8def-a067c1f1ea6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:38.037209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b8fc3-65d1-4774-8def-a067c1f1ea6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:38.039152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b8fc3-65d1-4774-8def-a067c1f1ea6c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:38.056318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 961/1931] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:01:38.061414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542f75-1b16-4f69-a039-1d753ed24586 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:38.086270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542f75-1b16-4f69-a039-1d753ed24586 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:38.100352 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b084f1-d690-4b63-ad87-ce53778aa44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:38.100983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b084f1-d690-4b63-ad87-ce53778aa44f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:38.101272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b084f1-d690-4b63-ad87-ce53778aa44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:38.101631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b084f1-d690-4b63-ad87-ce53778aa44f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:38.102424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b084f1-d690-4b63-ad87-ce53778aa44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:38.114429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b084f1-d690-4b63-ad87-ce53778aa44f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:38.146234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 971/1932] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:01:38.150830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b8fc3-65d1-4774-8def-a067c1f1ea6c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:38.162831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b8fc3-65d1-4774-8def-a067c1f1ea6c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:38.168752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:38.169528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:38.169931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:38.170307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] PATH_INFO: `/v3/projects/ca28272016f1484da9e3207eca2b01e4/users/588e03a52eeb45cf958f53e783497518/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:38.187779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca28272016f1484da9e3207eca2b01e4, user_id=588e03a52eeb45cf958f53e783497518, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:38.191057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:38.221165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 962/1933] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:01:38 2022] PUT /identity/v3/projects/ca28272016f1484da9e3207eca2b01e4/users/588e03a52eeb45cf958f53e783497518/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:01:38.232645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b45fd-c519-47c7-8c65-afd7db7fcae1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:38.233074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b45fd-c519-47c7-8c65-afd7db7fcae1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:38.233459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b45fd-c519-47c7-8c65-afd7db7fcae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:38.265208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8d9b45fd-c519-47c7-8c65-afd7db7fcae1 None None] MFA Rules not processed for user `588e03a52eeb45cf958f53e783497518`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:38.266667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d9b45fd-c519-47c7-8c65-afd7db7fcae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:38.343397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 972/1934] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:38.351719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:38.353844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:38.479926 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606461b1-3a1e-496d-b1a9-886c5328aa61 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:38.493101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:38.493728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:38.494003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:38.494272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:38.505482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:38.506970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:38.517699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 963/1935] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:46.887707 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8580e-fec0-423f-8dab-51179507d339 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:46.888275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8580e-fec0-423f-8dab-51179507d339 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:46.888275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8580e-fec0-423f-8dab-51179507d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:46.910216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ebb8580e-fec0-423f-8dab-51179507d339 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:46.911453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ebb8580e-fec0-423f-8dab-51179507d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:46.971827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 973/1936] 10.222.0.27 () {58 vars in 967 bytes} [Mon Oct 10 17:01:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:46.985465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:46.986877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:47.056209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c764480-5632-4fe1-994e-160209fadfd4 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:47.061382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae0653-2899-40b7-a3f3-fc0e7449e548 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:47.061909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0653-2899-40b7-a3f3-fc0e7449e548 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:47.062192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0653-2899-40b7-a3f3-fc0e7449e548 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:47.062469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0653-2899-40b7-a3f3-fc0e7449e548 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:47.070436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae0653-2899-40b7-a3f3-fc0e7449e548 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:47.072048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae0653-2899-40b7-a3f3-fc0e7449e548 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:47.080636 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 964/1937] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:01:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:01:49.179206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb324336-78f8-40d2-851e-ab16b4084ed6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.179206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb324336-78f8-40d2-851e-ab16b4084ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.179206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb324336-78f8-40d2-851e-ab16b4084ed6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.179951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 974/1938] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 17:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 17:01:49.209072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65ef9-44e3-4973-8f30-d129a39bb5ad None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.209601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65ef9-44e3-4973-8f30-d129a39bb5ad None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.209601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65ef9-44e3-4973-8f30-d129a39bb5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.229740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-61b65ef9-44e3-4973-8f30-d129a39bb5ad None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:49.231093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-61b65ef9-44e3-4973-8f30-d129a39bb5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:49.242202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:49.339860 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 965/1939] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 17:01:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:49.347440 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb324336-78f8-40d2-851e-ab16b4084ed6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:49.349255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bb324336-78f8-40d2-851e-ab16b4084ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:49.367473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8287093-1ec1-42ca-a04c-72828ddb958f None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.368375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8287093-1ec1-42ca-a04c-72828ddb958f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.368651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8287093-1ec1-42ca-a04c-72828ddb958f None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.374067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 966/1940] 10.222.0.27 () {54 vars in 961 bytes} [Mon Oct 10 17:01:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 17:01:49.375896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17079e5f-718b-4e64-9eba-8ed3226c4ea8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.376195 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17079e5f-718b-4e64-9eba-8ed3226c4ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.376476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17079e5f-718b-4e64-9eba-8ed3226c4ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.397239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-17079e5f-718b-4e64-9eba-8ed3226c4ea8 None None] MFA Rules not processed for user `6ad8898f985c41789f17984ef13bf5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:49.398456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-17079e5f-718b-4e64-9eba-8ed3226c4ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:49.413901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 967/1941] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Oct 10 17:01:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:49.423391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17079e5f-718b-4e64-9eba-8ed3226c4ea8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:49.435593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17079e5f-718b-4e64-9eba-8ed3226c4ea8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:49.442275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79c6e-6ee9-4b03-b545-026ef75792d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:49.442872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb324336-78f8-40d2-851e-ab16b4084ed6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:49.442987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79c6e-6ee9-4b03-b545-026ef75792d7 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.443268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79c6e-6ee9-4b03-b545-026ef75792d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.443716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79c6e-6ee9-4b03-b545-026ef75792d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.449082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:49.449729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.450006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.450277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] PATH_INFO: `/v3/users/ccb81c9022684b57854ebb28b3114ccc` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.451521 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb81c9022684b57854ebb28b3114ccc)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:49.453477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:49.455421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba79c6e-6ee9-4b03-b545-026ef75792d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:49.457169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba79c6e-6ee9-4b03-b545-026ef75792d7 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:49.471963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 968/1942] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:01:49.476129 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:49.524255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb81c9022684b57854ebb28b3114ccc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.525005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb81c9022684b57854ebb28b3114ccc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.533491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb81c9022684b57854ebb28b3114ccc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.546034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb81c9022684b57854ebb28b3114ccc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.546711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb81c9022684b57854ebb28b3114ccc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.560105 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 975/1943] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:01:49 2022] DELETE /identity/v3/users/ccb81c9022684b57854ebb28b3114ccc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:01:49.649495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79c6e-6ee9-4b03-b545-026ef75792d7 service placement] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:49.660063 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79c6e-6ee9-4b03-b545-026ef75792d7 service placement] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:49.717301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:49.717939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.718219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.718494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] PATH_INFO: `/v3/users/588e03a52eeb45cf958f53e783497518` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.719684 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588e03a52eeb45cf958f53e783497518)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:49.721609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:49.743373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:49.746085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:49.766629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103ad8-7500-454f-97b9-b08f05519f95 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:49.771591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:49.772414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.772823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.773268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] PATH_INFO: `/v3/projects/12955a710ddb42889264a18e8e6c7988` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.774688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12955a710ddb42889264a18e8e6c7988)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:49.776368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:49.781037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588e03a52eeb45cf958f53e783497518'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.793612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588e03a52eeb45cf958f53e783497518'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.800925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588e03a52eeb45cf958f53e783497518'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.801555 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588e03a52eeb45cf958f53e783497518'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.810028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6aea731-7e43-4b78-8e91-b50eec2e04a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588e03a52eeb45cf958f53e783497518'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.816480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 969/1944] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:01:49 2022] DELETE /identity/v3/users/588e03a52eeb45cf958f53e783497518 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:01:49.820865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99efd4-bcd0-4152-9d21-32a6e5d77db8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.821180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99efd4-bcd0-4152-9d21-32a6e5d77db8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.821461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99efd4-bcd0-4152-9d21-32a6e5d77db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.827308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12955a710ddb42889264a18e8e6c7988', 'request_id': 'req-783dfb26-880f-49a3-8f90-dce3e6e3d382'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.834830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12955a710ddb42889264a18e8e6c7988', 'request_id': 'req-783dfb26-880f-49a3-8f90-dce3e6e3d382'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.840943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12955a710ddb42889264a18e8e6c7988', 'request_id': 'req-783dfb26-880f-49a3-8f90-dce3e6e3d382'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.841070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ca99efd4-bcd0-4152-9d21-32a6e5d77db8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:49.842197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ca99efd4-bcd0-4152-9d21-32a6e5d77db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:49.847591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:49.856164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] The token cache is being invalidate because project 12955a710ddb42889264a18e8e6c7988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:01:49.856567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.857251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-783dfb26-880f-49a3-8f90-dce3e6e3d382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:49.859234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 976/1945] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:01:49 2022] DELETE /identity/v3/projects/12955a710ddb42889264a18e8e6c7988 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:01:49.864251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336867fe-13ce-42c2-b864-43782b294e4f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.864589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336867fe-13ce-42c2-b864-43782b294e4f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.864870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336867fe-13ce-42c2-b864-43782b294e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.887844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-336867fe-13ce-42c2-b864-43782b294e4f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:49.889389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-336867fe-13ce-42c2-b864-43782b294e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:49.911491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 970/1946] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:49.922683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99efd4-bcd0-4152-9d21-32a6e5d77db8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:49.924013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ca99efd4-bcd0-4152-9d21-32a6e5d77db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:49.952216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 977/1947] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:01:49.960947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775aff-73b8-4931-8cae-45045b33d892 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.961242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775aff-73b8-4931-8cae-45045b33d892 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.961525 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775aff-73b8-4931-8cae-45045b33d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.984421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1e775aff-73b8-4931-8cae-45045b33d892 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:49.985631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1e775aff-73b8-4931-8cae-45045b33d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:49.990950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99efd4-bcd0-4152-9d21-32a6e5d77db8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:49.994223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 978/1948] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:01:49.995628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa33a2b-5fb4-428d-bcfd-f8b15a2e477a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:49.996234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa33a2b-5fb4-428d-bcfd-f8b15a2e477a service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:49.996507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa33a2b-5fb4-428d-bcfd-f8b15a2e477a service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:49.996772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa33a2b-5fb4-428d-bcfd-f8b15a2e477a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:49.999548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775aff-73b8-4931-8cae-45045b33d892 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:50.007444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa33a2b-5fb4-428d-bcfd-f8b15a2e477a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.009167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa33a2b-5fb4-428d-bcfd-f8b15a2e477a service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.009451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775aff-73b8-4931-8cae-45045b33d892 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:50.014453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:50.015101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.015388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.015665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.016320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:01:50.016630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.018219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.020180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 971/1949] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:01:50.028150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:50.040414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa33a2b-5fb4-428d-bcfd-f8b15a2e477a service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:50.040699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 979/1950] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:01:50.052743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa33a2b-5fb4-428d-bcfd-f8b15a2e477a service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:50.058487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e99258-b318-424a-992a-baaad96bada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:50.059157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e99258-b318-424a-992a-baaad96bada9 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.059441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e99258-b318-424a-992a-baaad96bada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.059718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e99258-b318-424a-992a-baaad96bada9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.060393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e99258-b318-424a-992a-baaad96bada9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.062439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e99258-b318-424a-992a-baaad96bada9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.098771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 972/1951] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:01:50 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:01:50.103096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:50.113912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0cba9-4702-4b32-a4ea-e2f25a5bf010 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:50.179860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531676-12a9-47d6-9c91-f46180b3e1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:50.181297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531676-12a9-47d6-9c91-f46180b3e1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.181592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531676-12a9-47d6-9c91-f46180b3e1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.182416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531676-12a9-47d6-9c91-f46180b3e1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.183185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531676-12a9-47d6-9c91-f46180b3e1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.185125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531676-12a9-47d6-9c91-f46180b3e1a1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.209327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 980/1952] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:01:50 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:01:50.214310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e99258-b318-424a-992a-baaad96bada9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:50.225389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e99258-b318-424a-992a-baaad96bada9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:50.231646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b153516-2fe0-445b-8dea-79e1d8c5f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:50.232262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153516-2fe0-445b-8dea-79e1d8c5f7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.232548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153516-2fe0-445b-8dea-79e1d8c5f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.232822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153516-2fe0-445b-8dea-79e1d8c5f7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.233474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b153516-2fe0-445b-8dea-79e1d8c5f7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.235117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b153516-2fe0-445b-8dea-79e1d8c5f7f5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.246864 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 973/1953] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:01:50.250839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531676-12a9-47d6-9c91-f46180b3e1a1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:50.262423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531676-12a9-47d6-9c91-f46180b3e1a1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:50.270496 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fc75c-40dd-4fd4-8135-91283858d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:50.271168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc75c-40dd-4fd4-8135-91283858d969 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.271517 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc75c-40dd-4fd4-8135-91283858d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.271860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc75c-40dd-4fd4-8135-91283858d969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.272569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fc75c-40dd-4fd4-8135-91283858d969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.274242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fc75c-40dd-4fd4-8135-91283858d969 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.287690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 981/1954] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:01:50.291962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b153516-2fe0-445b-8dea-79e1d8c5f7f5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:50.302566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b153516-2fe0-445b-8dea-79e1d8c5f7f5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:50.307938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:50.308599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.308884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.309161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] PATH_INFO: `/v3/projects/2f405673c3b14a5596ecb5d5ca53cbf9/users/6d2a34ce97b34c1897ffbe8eac2a587e/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.325071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f405673c3b14a5596ecb5d5ca53cbf9, user_id=6d2a34ce97b34c1897ffbe8eac2a587e, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.327886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.343108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 974/1955] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:01:50 2022] PUT /identity/v3/projects/2f405673c3b14a5596ecb5d5ca53cbf9/users/6d2a34ce97b34c1897ffbe8eac2a587e/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:01:50.353325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca79b-9fb8-44d9-8744-3c62fb2e2da8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.353759 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca79b-9fb8-44d9-8744-3c62fb2e2da8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.354644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca79b-9fb8-44d9-8744-3c62fb2e2da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.364324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:50.366703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:50.395402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c84ca79b-9fb8-44d9-8744-3c62fb2e2da8 None None] MFA Rules not processed for user `6d2a34ce97b34c1897ffbe8eac2a587e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:50.396828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c84ca79b-9fb8-44d9-8744-3c62fb2e2da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:50.464733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:50.470360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc311f-5338-4934-8c28-8cd5abb3084b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:50.477241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:50.478029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.478379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.479361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] PATH_INFO: `/v3/projects/ca28272016f1484da9e3207eca2b01e4` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.480594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca28272016f1484da9e3207eca2b01e4)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.482809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.512038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 982/1956] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:01:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:50.531443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca79b-9fb8-44d9-8744-3c62fb2e2da8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:50.538979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c84ca79b-9fb8-44d9-8744-3c62fb2e2da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:50.552436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca28272016f1484da9e3207eca2b01e4', 'request_id': 'req-85b257a8-be56-4dcb-af32-27183094f5fb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:50.559938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca28272016f1484da9e3207eca2b01e4', 'request_id': 'req-85b257a8-be56-4dcb-af32-27183094f5fb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:50.566806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca28272016f1484da9e3207eca2b01e4', 'request_id': 'req-85b257a8-be56-4dcb-af32-27183094f5fb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:50.585186 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] The token cache is being invalidate because project ca28272016f1484da9e3207eca2b01e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:01:50.585536 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:50.586259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85b257a8-be56-4dcb-af32-27183094f5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:01:50.588318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 975/1957] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:01:50 2022] DELETE /identity/v3/projects/ca28272016f1484da9e3207eca2b01e4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:01:50.659543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca79b-9fb8-44d9-8744-3c62fb2e2da8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:50.709703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:01:50.749504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ede14ff816494505b20faba615bc5026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:50.750125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:50.750402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:50.750703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:50.752465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:50.819346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:50.820722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:50.830581 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 983/1958] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:01:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:01:52.459483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fa769-fff5-4e26-9652-4cca4bc54991 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:52.459975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fa769-fff5-4e26-9652-4cca4bc54991 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:52.460066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fa769-fff5-4e26-9652-4cca4bc54991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:52.479866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a98fa769-fff5-4e26-9652-4cca4bc54991 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:01:52.481070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a98fa769-fff5-4e26-9652-4cca4bc54991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:52.535819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 976/1959] 10.222.0.27 () {58 vars in 967 bytes} [Mon Oct 10 17:01:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:01:52.549454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:01:52.550968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:01:52.621158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c33e3-4b84-4f3e-b92b-d8d8bd31e2ce service glance] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:01:52.626171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:01:52.626793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:01:52.627069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:01:52.627340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:01:52.638144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:01:52.638144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:01:52.646495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 984/1960] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:01:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 17:02:02.530155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:02.642768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=70 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:12.891311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fa769-fff5-4e26-9652-4cca4bc54991 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:12.893342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a98fa769-fff5-4e26-9652-4cca4bc54991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:12.999731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fa769-fff5-4e26-9652-4cca4bc54991 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:13.005673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677cb2-2d90-46c0-a5d0-603cce25950f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:13.006572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677cb2-2d90-46c0-a5d0-603cce25950f service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:13.006966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677cb2-2d90-46c0-a5d0-603cce25950f service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:13.007335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677cb2-2d90-46c0-a5d0-603cce25950f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:13.009314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ca677cb2-2d90-46c0-a5d0-603cce25950f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:13.029995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677cb2-2d90-46c0-a5d0-603cce25950f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:13.032170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677cb2-2d90-46c0-a5d0-603cce25950f service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:13.050605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 977/1961] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:02:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:02:16.047608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:16.049206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:16.115894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae1d4-4840-4656-97f8-064eff87f2af service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:16.120808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:16.121455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:16.122303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:16.122635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] PATH_INFO: `/v3/users/6d2a34ce97b34c1897ffbe8eac2a587e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:16.123764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2a34ce97b34c1897ffbe8eac2a587e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:16.125695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:16.178698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2a34ce97b34c1897ffbe8eac2a587e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.179377 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2a34ce97b34c1897ffbe8eac2a587e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.187706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2a34ce97b34c1897ffbe8eac2a587e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.200303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2a34ce97b34c1897ffbe8eac2a587e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.201278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2a34ce97b34c1897ffbe8eac2a587e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.214369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 985/1962] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:02:16 2022] DELETE /identity/v3/users/6d2a34ce97b34c1897ffbe8eac2a587e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:02:16.220342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deb0aa-142d-4dc6-8366-deec4620aa4b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:16.221175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deb0aa-142d-4dc6-8366-deec4620aa4b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:16.221175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deb0aa-142d-4dc6-8366-deec4620aa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:16.247259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b6deb0aa-142d-4dc6-8366-deec4620aa4b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:16.248489 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b6deb0aa-142d-4dc6-8366-deec4620aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:16.312683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 978/1963] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:02:16.322701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:16.324285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:16.389282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173658e-3ff1-405d-8bff-aa6e09a5b2ac admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:16.396301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311b9e-f103-48f8-b49e-ba7f183ae239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:16.397039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311b9e-f103-48f8-b49e-ba7f183ae239 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:16.397393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311b9e-f103-48f8-b49e-ba7f183ae239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:16.398690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311b9e-f103-48f8-b49e-ba7f183ae239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:16.411046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d311b9e-f103-48f8-b49e-ba7f183ae239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:16.412490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d311b9e-f103-48f8-b49e-ba7f183ae239 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:16.423662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 986/1964] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:02:16.759802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6deb0aa-142d-4dc6-8366-deec4620aa4b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:16.762838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b6deb0aa-142d-4dc6-8366-deec4620aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:16.779881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6deb0aa-142d-4dc6-8366-deec4620aa4b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:16.785212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:16.785873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:16.786148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:16.786416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] PATH_INFO: `/v3/projects/2f405673c3b14a5596ecb5d5ca53cbf9` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:16.788132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f405673c3b14a5596ecb5d5ca53cbf9)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:16.790421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:16.852033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f405673c3b14a5596ecb5d5ca53cbf9', 'request_id': 'req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.859292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f405673c3b14a5596ecb5d5ca53cbf9', 'request_id': 'req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.864971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f405673c3b14a5596ecb5d5ca53cbf9', 'request_id': 'req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.878781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] The token cache is being invalidate because project 2f405673c3b14a5596ecb5d5ca53cbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:02:16.879098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.879752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2402ddf7-8246-4efe-8c78-05d6cc1a90b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:16.881346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 979/1965] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:02:16 2022] DELETE /identity/v3/projects/2f405673c3b14a5596ecb5d5ca53cbf9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:02:16.886312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1c27-16ba-487f-b45a-e9eea3dfd88c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:16.886634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1c27-16ba-487f-b45a-e9eea3dfd88c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:16.886967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1c27-16ba-487f-b45a-e9eea3dfd88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:16.910275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d32e1c27-16ba-487f-b45a-e9eea3dfd88c None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:16.911539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d32e1c27-16ba-487f-b45a-e9eea3dfd88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:16.928970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:16.977298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 987/1966] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:16.985513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a1f18-6c5c-4f77-aeb9-0a6d0ebf09c3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:16.985795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a1f18-6c5c-4f77-aeb9-0a6d0ebf09c3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:16.986065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a1f18-6c5c-4f77-aeb9-0a6d0ebf09c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.006967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6e8a1f18-6c5c-4f77-aeb9-0a6d0ebf09c3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:17.008081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6e8a1f18-6c5c-4f77-aeb9-0a6d0ebf09c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:17.016448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 980/1967] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:17.020659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e1c27-16ba-487f-b45a-e9eea3dfd88c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:17.030504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e1c27-16ba-487f-b45a-e9eea3dfd88c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:17.035391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:17.035991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:17.036280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:17.036548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.037195 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:02:17.037491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:17.039751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:17.051674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 988/1968] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:02:17.056194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a1f18-6c5c-4f77-aeb9-0a6d0ebf09c3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:17.066353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a1f18-6c5c-4f77-aeb9-0a6d0ebf09c3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:17.070999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77a2b-ce80-4dd5-b6af-3ddd67036115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:17.071594 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77a2b-ce80-4dd5-b6af-3ddd67036115 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:17.071868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77a2b-ce80-4dd5-b6af-3ddd67036115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:17.072139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77a2b-ce80-4dd5-b6af-3ddd67036115 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.072777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c77a2b-ce80-4dd5-b6af-3ddd67036115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:17.075313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c77a2b-ce80-4dd5-b6af-3ddd67036115 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:17.079862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:17.103462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 981/1969] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:02:17 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:02:17.107810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:17.117850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5b9f-fa82-4368-a782-fa4408b609d1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:17.179296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fb972-3685-4bb6-baf3-65d5b60aefb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:17.179918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fb972-3685-4bb6-baf3-65d5b60aefb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:17.180196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fb972-3685-4bb6-baf3-65d5b60aefb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:17.180467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fb972-3685-4bb6-baf3-65d5b60aefb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.181113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fb972-3685-4bb6-baf3-65d5b60aefb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:17.183073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fb972-3685-4bb6-baf3-65d5b60aefb7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:17.204481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 989/1970] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:02:17 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:02:17.208533 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77a2b-ce80-4dd5-b6af-3ddd67036115 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:17.219593 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77a2b-ce80-4dd5-b6af-3ddd67036115 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:17.224198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e18f2-0da2-4f79-8560-00cb74b89740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:17.224794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e18f2-0da2-4f79-8560-00cb74b89740 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:17.225064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e18f2-0da2-4f79-8560-00cb74b89740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:17.225338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e18f2-0da2-4f79-8560-00cb74b89740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.225980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e18f2-0da2-4f79-8560-00cb74b89740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:17.227625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e18f2-0da2-4f79-8560-00cb74b89740 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:17.238038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 982/1971] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:02:17.242221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fb972-3685-4bb6-baf3-65d5b60aefb7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:17.253032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fb972-3685-4bb6-baf3-65d5b60aefb7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:17.257893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f0e8d-0030-4da8-b5a6-f89ceccf2dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:17.258491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f0e8d-0030-4da8-b5a6-f89ceccf2dee admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:17.258800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f0e8d-0030-4da8-b5a6-f89ceccf2dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:17.259075 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f0e8d-0030-4da8-b5a6-f89ceccf2dee admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.259721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f0e8d-0030-4da8-b5a6-f89ceccf2dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:17.261362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f0e8d-0030-4da8-b5a6-f89ceccf2dee admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:17.272987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 990/1972] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:02:17.277129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e18f2-0da2-4f79-8560-00cb74b89740 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:17.288506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e18f2-0da2-4f79-8560-00cb74b89740 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:17.293236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:17.294439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:17.294763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:17.295040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] PATH_INFO: `/v3/projects/a151f86d9b0a4dbca33fb9975b2a3482/users/264c66e53ed44649bce96127f17abc36/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.310965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a151f86d9b0a4dbca33fb9975b2a3482, user_id=264c66e53ed44649bce96127f17abc36, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:17.313647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:17.327330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 983/1973] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:02:17 2022] PUT /identity/v3/projects/a151f86d9b0a4dbca33fb9975b2a3482/users/264c66e53ed44649bce96127f17abc36/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:02:17.397495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02b7d7-3d71-4b5c-aff6-8bada4142534 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:17.398120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02b7d7-3d71-4b5c-aff6-8bada4142534 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:17.398688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02b7d7-3d71-4b5c-aff6-8bada4142534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.428184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2f02b7d7-3d71-4b5c-aff6-8bada4142534 None None] MFA Rules not processed for user `264c66e53ed44649bce96127f17abc36`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:17.429479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2f02b7d7-3d71-4b5c-aff6-8bada4142534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:17.498689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 991/1974] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:17.509698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:17.511445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:17.567411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda629e9-f133-42b6-b768-e31337b2608d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:17.570988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aee0f6-e066-4d88-b5c4-cea2dadfc668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:17.571568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee0f6-e066-4d88-b5c4-cea2dadfc668 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:17.571843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee0f6-e066-4d88-b5c4-cea2dadfc668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:17.572115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee0f6-e066-4d88-b5c4-cea2dadfc668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:17.580246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aee0f6-e066-4d88-b5c4-cea2dadfc668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:17.581651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aee0f6-e066-4d88-b5c4-cea2dadfc668 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:17.590442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 984/1975] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:02:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:02:18.958420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32b611-27f3-4151-97bb-94d910b818b3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:18.958942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32b611-27f3-4151-97bb-94d910b818b3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:18.959053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32b611-27f3-4151-97bb-94d910b818b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:18.977784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9c32b611-27f3-4151-97bb-94d910b818b3 None None] MFA Rules not processed for user `264c66e53ed44649bce96127f17abc36`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:18.979023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9c32b611-27f3-4151-97bb-94d910b818b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:18.986401 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 992/1976] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:24.641822 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2ebe6-d97f-4f0c-8810-88475c367609 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:24.642304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2ebe6-d97f-4f0c-8810-88475c367609 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:24.642396 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2ebe6-d97f-4f0c-8810-88475c367609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:24.661271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b1d2ebe6-d97f-4f0c-8810-88475c367609 None None] MFA Rules not processed for user `9d51c7335010488d8a2bdc329f975dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:24.662476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b1d2ebe6-d97f-4f0c-8810-88475c367609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:24.716406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 985/1977] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:28.972529 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:34.709625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:36.542592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566b16c-705f-441d-b377-120240ecc678 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:36.543074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566b16c-705f-441d-b377-120240ecc678 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:36.543167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566b16c-705f-441d-b377-120240ecc678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:36.562784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e566b16c-705f-441d-b377-120240ecc678 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:36.563993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e566b16c-705f-441d-b377-120240ecc678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:36.622696 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 993/1978] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:02:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:36.645114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2ebe6-d97f-4f0c-8810-88475c367609 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:36.646604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b1d2ebe6-d97f-4f0c-8810-88475c367609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:36.720120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2ebe6-d97f-4f0c-8810-88475c367609 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:36.725013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c89494-5770-40fb-9d50-e682716f6425 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:36.725622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c89494-5770-40fb-9d50-e682716f6425 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:36.725893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c89494-5770-40fb-9d50-e682716f6425 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:36.726163 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c89494-5770-40fb-9d50-e682716f6425 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:36.735096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c89494-5770-40fb-9d50-e682716f6425 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:36.736682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c89494-5770-40fb-9d50-e682716f6425 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:36.744951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 986/1979] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:02:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:02:37.286272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd253-6e64-49c5-a832-51940e5f2f69 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:37.286592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd253-6e64-49c5-a832-51940e5f2f69 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:37.286875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd253-6e64-49c5-a832-51940e5f2f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:37.307587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-867dd253-6e64-49c5-a832-51940e5f2f69 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:37.308799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-867dd253-6e64-49c5-a832-51940e5f2f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:37.316702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 994/1980] 10.222.0.27 () {58 vars in 967 bytes} [Mon Oct 10 17:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:37.329174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c89494-5770-40fb-9d50-e682716f6425 service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:37.339837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c89494-5770-40fb-9d50-e682716f6425 service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:37.346259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464c634-a2e4-4b5e-adc9-db8ce22328d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:37.346882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464c634-a2e4-4b5e-adc9-db8ce22328d2 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:37.347160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464c634-a2e4-4b5e-adc9-db8ce22328d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:37.347433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464c634-a2e4-4b5e-adc9-db8ce22328d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:37.355826 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464c634-a2e4-4b5e-adc9-db8ce22328d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:37.358006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464c634-a2e4-4b5e-adc9-db8ce22328d2 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:37.366259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 987/1981] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:02:37.610482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb7a8b-7f4a-491f-8ff7-0e39de7a6c2e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:37.610991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb7a8b-7f4a-491f-8ff7-0e39de7a6c2e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:37.611345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb7a8b-7f4a-491f-8ff7-0e39de7a6c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:37.632618 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-95eb7a8b-7f4a-491f-8ff7-0e39de7a6c2e None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:37.633810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-95eb7a8b-7f4a-491f-8ff7-0e39de7a6c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:37.656879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 995/1982] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:37.657761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464c634-a2e4-4b5e-adc9-db8ce22328d2 service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:37.665524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464c634-a2e4-4b5e-adc9-db8ce22328d2 service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:37.671044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657424-5c45-438f-a759-08b4c650b167 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:37.671624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657424-5c45-438f-a759-08b4c650b167 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:37.671898 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657424-5c45-438f-a759-08b4c650b167 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:37.672166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657424-5c45-438f-a759-08b4c650b167 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:37.679982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657424-5c45-438f-a759-08b4c650b167 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:37.681548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657424-5c45-438f-a759-08b4c650b167 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:37.690132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 988/1983] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:02:38.020922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4c07-1701-48a0-9ce3-3de53c8c527d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:38.021210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4c07-1701-48a0-9ce3-3de53c8c527d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:38.021485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4c07-1701-48a0-9ce3-3de53c8c527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:38.042383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-39bb4c07-1701-48a0-9ce3-3de53c8c527d None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:38.043556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-39bb4c07-1701-48a0-9ce3-3de53c8c527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:38.051539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 996/1984] 10.222.0.27 () {58 vars in 967 bytes} [Mon Oct 10 17:02:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:02:38.064517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657424-5c45-438f-a759-08b4c650b167 service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:38.075153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657424-5c45-438f-a759-08b4c650b167 service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:38.080258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbfc6c-f256-4ec9-9861-e6c701b0b8d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:38.080844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfc6c-f256-4ec9-9861-e6c701b0b8d9 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:38.081119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfc6c-f256-4ec9-9861-e6c701b0b8d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:38.081390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfc6c-f256-4ec9-9861-e6c701b0b8d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:38.089393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbfc6c-f256-4ec9-9861-e6c701b0b8d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:38.091481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbfc6c-f256-4ec9-9861-e6c701b0b8d9 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:38.099372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 989/1985] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 17:02:40.256785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4c07-1701-48a0-9ce3-3de53c8c527d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:40.322645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4c07-1701-48a0-9ce3-3de53c8c527d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:40.327689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:40.328399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:40.328773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:40.329219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] PATH_INFO: `/v3/users/264c66e53ed44649bce96127f17abc36` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:40.330422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=264c66e53ed44649bce96127f17abc36)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:40.332553 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:40.383455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264c66e53ed44649bce96127f17abc36'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.384108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264c66e53ed44649bce96127f17abc36'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.391322 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264c66e53ed44649bce96127f17abc36'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.404405 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264c66e53ed44649bce96127f17abc36'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.405125 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264c66e53ed44649bce96127f17abc36'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.419106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 997/1986] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:02:40 2022] DELETE /identity/v3/users/264c66e53ed44649bce96127f17abc36 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:02:40.423580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3669285-bb60-4bcd-a311-8b9edd27aacc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:40.424084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3669285-bb60-4bcd-a311-8b9edd27aacc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:40.424205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3669285-bb60-4bcd-a311-8b9edd27aacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:40.443628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a3669285-bb60-4bcd-a311-8b9edd27aacc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:40.444812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a3669285-bb60-4bcd-a311-8b9edd27aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:40.505697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 990/1987] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:40.515566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:40.517115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:40.524631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:40.580041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff58b9-099c-479d-9479-4dbc9bec5dbf admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:40.583671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a0081-d8e7-40a9-8a42-ecce269117b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:40.584301 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a0081-d8e7-40a9-8a42-ecce269117b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:40.584579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a0081-d8e7-40a9-8a42-ecce269117b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:40.584847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a0081-d8e7-40a9-8a42-ecce269117b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:40.595516 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a0081-d8e7-40a9-8a42-ecce269117b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:40.597093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a0081-d8e7-40a9-8a42-ecce269117b7 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:40.607848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 998/1988] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:02:40.804052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3669285-bb60-4bcd-a311-8b9edd27aacc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:02:40.805469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a3669285-bb60-4bcd-a311-8b9edd27aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:40.820114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3669285-bb60-4bcd-a311-8b9edd27aacc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:02:40.825735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:02:40.826643 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:40.826922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:40.827191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] PATH_INFO: `/v3/projects/a151f86d9b0a4dbca33fb9975b2a3482` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:40.828338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a151f86d9b0a4dbca33fb9975b2a3482)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:02:40.830417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:02:40.887319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:40.892232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a151f86d9b0a4dbca33fb9975b2a3482', 'request_id': 'req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.900624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a151f86d9b0a4dbca33fb9975b2a3482', 'request_id': 'req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.906924 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a151f86d9b0a4dbca33fb9975b2a3482', 'request_id': 'req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.920299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] The token cache is being invalidate because project a151f86d9b0a4dbca33fb9975b2a3482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:02:40.920732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.921388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e7f40e6d-cbf9-4ce3-a89f-8700f26eb8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:02:40.922942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 991/1989] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:02:40 2022] DELETE /identity/v3/projects/a151f86d9b0a4dbca33fb9975b2a3482 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:02:45.217540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e85cd1-cb9a-4345-81e8-5409de0841e5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:45.218074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e85cd1-cb9a-4345-81e8-5409de0841e5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:45.218074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e85cd1-cb9a-4345-81e8-5409de0841e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:45.237088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f3e85cd1-cb9a-4345-81e8-5409de0841e5 None None] MFA Rules not processed for user `4e66774737b5439d8b615cbb271f1faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:45.238270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f3e85cd1-cb9a-4345-81e8-5409de0841e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:45.293003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 999/1990] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:47.481764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a9a3-2838-4354-b7e6-f40551aef8d3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:02:47.482275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a9a3-2838-4354-b7e6-f40551aef8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:02:47.482376 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a9a3-2838-4354-b7e6-f40551aef8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:02:47.502850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ea13a9a3-2838-4354-b7e6-f40551aef8d3 None None] MFA Rules not processed for user `0046dc0cc60049ae8ea43797c84aef61`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:02:47.504042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ea13a9a3-2838-4354-b7e6-f40551aef8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:02:47.556735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 992/1991] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:02:55.286362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=49 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:02:57.550190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=4,keystone:SELECT=32,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:03:39.232553 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108bd30-b54e-420c-9f4c-9bb253d68b83 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:39.233036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108bd30-b54e-420c-9f4c-9bb253d68b83 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:39.233036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108bd30-b54e-420c-9f4c-9bb253d68b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:39.253489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1108bd30-b54e-420c-9f4c-9bb253d68b83 None None] MFA Rules not processed for user `9d51c7335010488d8a2bdc329f975dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:03:39.254738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1108bd30-b54e-420c-9f4c-9bb253d68b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:03:39.314677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1000/1992] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:03:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:03:49.309275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=25 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:03:50.721358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a9a3-2838-4354-b7e6-f40551aef8d3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:03:50.722920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ea13a9a3-2838-4354-b7e6-f40551aef8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:03:50.780560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a9a3-2838-4354-b7e6-f40551aef8d3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:03:50.784103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccabb6-3189-4a54-a498-18bdcf5f3922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:03:50.784709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccabb6-3189-4a54-a498-18bdcf5f3922 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:50.784988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccabb6-3189-4a54-a498-18bdcf5f3922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:50.785262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccabb6-3189-4a54-a498-18bdcf5f3922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:50.787011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dfccabb6-3189-4a54-a498-18bdcf5f3922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:03:50.858941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccabb6-3189-4a54-a498-18bdcf5f3922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:03:50.860394 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccabb6-3189-4a54-a498-18bdcf5f3922 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:03:50.871615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 993/1993] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:03:51.562642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108bd30-b54e-420c-9f4c-9bb253d68b83 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:03:51.572358 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108bd30-b54e-420c-9f4c-9bb253d68b83 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:03:51.576592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1160e-2150-4fcd-8b38-805f64f71177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:03:51.577194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1160e-2150-4fcd-8b38-805f64f71177 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:51.577473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1160e-2150-4fcd-8b38-805f64f71177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:51.577743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1160e-2150-4fcd-8b38-805f64f71177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:51.579491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-91c1160e-2150-4fcd-8b38-805f64f71177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:03:51.593752 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1160e-2150-4fcd-8b38-805f64f71177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:03:51.595368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1160e-2150-4fcd-8b38-805f64f71177 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:03:51.607019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1001/1994] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:03:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:03:55.704625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247c13-f344-44e5-abb5-14f74f959362 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:55.705105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247c13-f344-44e5-abb5-14f74f959362 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:55.705310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247c13-f344-44e5-abb5-14f74f959362 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:55.706852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 994/1995] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 17:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 17:03:55.716577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79db09-2648-4655-a9fa-2f69d4b8bcf7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:55.717073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79db09-2648-4655-a9fa-2f69d4b8bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:55.717431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79db09-2648-4655-a9fa-2f69d4b8bcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:55.738208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-de79db09-2648-4655-a9fa-2f69d4b8bcf7 None None] MFA Rules not processed for user `b3d805106909465abd09c0daf5ecc1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:03:55.739459 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-de79db09-2648-4655-a9fa-2f69d4b8bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:03:55.747018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1002/1996] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 17:03:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:03:55.759302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247c13-f344-44e5-abb5-14f74f959362 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:03:55.761712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8e247c13-f344-44e5-abb5-14f74f959362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:03:55.775413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247c13-f344-44e5-abb5-14f74f959362 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:03:55.779692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f404c-579b-4e0c-ab2b-187635dbd20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:03:55.780285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f404c-579b-4e0c-ab2b-187635dbd20d service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:55.780560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f404c-579b-4e0c-ab2b-187635dbd20d service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:55.780829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f404c-579b-4e0c-ab2b-187635dbd20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:55.788028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f404c-579b-4e0c-ab2b-187635dbd20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:03:55.789451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f404c-579b-4e0c-ab2b-187635dbd20d service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:03:55.797965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 995/1997] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:03:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:03:55.882845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe2ca7-9376-4dc0-926b-c40208624aa6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:55.883137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe2ca7-9376-4dc0-926b-c40208624aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:55.883419 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe2ca7-9376-4dc0-926b-c40208624aa6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:55.884785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1003/1998] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 17:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 17:03:55.891001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af850-03f5-4e07-a8ad-70e1ef946276 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:55.891287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af850-03f5-4e07-a8ad-70e1ef946276 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:55.891706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af850-03f5-4e07-a8ad-70e1ef946276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:55.913187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1a4af850-03f5-4e07-a8ad-70e1ef946276 None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:03:55.914371 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a4af850-03f5-4e07-a8ad-70e1ef946276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:03:55.924099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 996/1999] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 17:03:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:03:55.935201 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe2ca7-9376-4dc0-926b-c40208624aa6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:03:55.945920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe2ca7-9376-4dc0-926b-c40208624aa6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:03:55.951145 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:03:55.951737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:03:55.952012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:03:55.952314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:03:55.962657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:03:55.964348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:03:55.975422 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1004/2000] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:03:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:00.247524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af850-03f5-4e07-a8ad-70e1ef946276 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:00.267908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af850-03f5-4e07-a8ad-70e1ef946276 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:00.272458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2ca44-c169-4f32-9c9c-f37f5782043b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:00.273408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ca44-c169-4f32-9c9c-f37f5782043b service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:00.274162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ca44-c169-4f32-9c9c-f37f5782043b service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:00.274693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ca44-c169-4f32-9c9c-f37f5782043b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:00.276853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8da2ca44-c169-4f32-9c9c-f37f5782043b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:00.389892 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2ca44-c169-4f32-9c9c-f37f5782043b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:00.393416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2ca44-c169-4f32-9c9c-f37f5782043b service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:00.410867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 997/2001] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:05.970485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=15 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:05.973406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:05.976316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:05.992941 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b776dc-ee20-4b3a-ab09-55ca01cff3cd service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:05.999827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:06.000573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.000950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.001319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] PATH_INFO: `/v3/users/4e66774737b5439d8b615cbb271f1faa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.002695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e66774737b5439d8b615cbb271f1faa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:06.004799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:06.059247 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e66774737b5439d8b615cbb271f1faa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.060331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e66774737b5439d8b615cbb271f1faa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.069429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e66774737b5439d8b615cbb271f1faa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.085370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e66774737b5439d8b615cbb271f1faa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.086214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e66774737b5439d8b615cbb271f1faa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.102691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1005/2002] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:05 2022] DELETE /identity/v3/users/4e66774737b5439d8b615cbb271f1faa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:04:06.236421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de9aa3-f686-4b15-9a39-1bdf045d8dbf None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.236991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de9aa3-f686-4b15-9a39-1bdf045d8dbf None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.236991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de9aa3-f686-4b15-9a39-1bdf045d8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.257732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-90de9aa3-f686-4b15-9a39-1bdf045d8dbf None None] MFA Rules not processed for user `05ace9c538754a1cad4a6dc9fc8b7bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:06.258999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-90de9aa3-f686-4b15-9a39-1bdf045d8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:06.269690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:06.297002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:06.298850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:06.338347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 998/2003] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:06.377734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df01921-cba5-4a52-80ba-22c8d7ae4865 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:06.385048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:06.386331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.386773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.387154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] PATH_INFO: `/v3/projects/b4f5324f494f4c6f9193a0cfb5466f3a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.388455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f5324f494f4c6f9193a0cfb5466f3a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:06.390474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:06.449037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f5324f494f4c6f9193a0cfb5466f3a', 'request_id': 'req-26e06ab8-da58-427a-94a8-7b3296585502'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.456280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f5324f494f4c6f9193a0cfb5466f3a', 'request_id': 'req-26e06ab8-da58-427a-94a8-7b3296585502'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.462660 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f5324f494f4c6f9193a0cfb5466f3a', 'request_id': 'req-26e06ab8-da58-427a-94a8-7b3296585502'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.478502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] The token cache is being invalidate because project b4f5324f494f4c6f9193a0cfb5466f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:04:06.482700 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.483733 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-26e06ab8-da58-427a-94a8-7b3296585502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:06.485332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1006/2004] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:04:06 2022] DELETE /identity/v3/projects/b4f5324f494f4c6f9193a0cfb5466f3a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:06.490947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165852-d447-431c-9979-da6d39f8e786 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.491237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165852-d447-431c-9979-da6d39f8e786 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.492448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165852-d447-431c-9979-da6d39f8e786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.515342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a0165852-d447-431c-9979-da6d39f8e786 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:06.516569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a0165852-d447-431c-9979-da6d39f8e786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:06.616120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 999/2005] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:06.623924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86d7e-3d85-4295-83a7-2a000aef1c21 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.624213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86d7e-3d85-4295-83a7-2a000aef1c21 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.624629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86d7e-3d85-4295-83a7-2a000aef1c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.634461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:06.659461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bfc86d7e-3d85-4295-83a7-2a000aef1c21 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:06.659645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bfc86d7e-3d85-4295-83a7-2a000aef1c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:06.674371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1007/2006] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:06.676257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0165852-d447-431c-9979-da6d39f8e786 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:06.690478 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0165852-d447-431c-9979-da6d39f8e786 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:06.699061 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:06.699642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.699931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.700209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.701073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:04:06.701642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:06.704235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:06.724123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1000/2007] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:04:06.728300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc86d7e-3d85-4295-83a7-2a000aef1c21 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:06.740110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc86d7e-3d85-4295-83a7-2a000aef1c21 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:06.763407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdd9c0-452d-4596-ac7b-86d5f05cd98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:06.765765 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd9c0-452d-4596-ac7b-86d5f05cd98a admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.766319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd9c0-452d-4596-ac7b-86d5f05cd98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.766839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd9c0-452d-4596-ac7b-86d5f05cd98a admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.767726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdd9c0-452d-4596-ac7b-86d5f05cd98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:06.770898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdd9c0-452d-4596-ac7b-86d5f05cd98a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:06.814296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1008/2008] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:06 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:06.818511 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:06.838235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0a48-805f-447e-a196-45bbaa8de251 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:06.938147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28571548-352b-4aa9-8d9c-e301c3278bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:06.938804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28571548-352b-4aa9-8d9c-e301c3278bad admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.939226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28571548-352b-4aa9-8d9c-e301c3278bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.939567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28571548-352b-4aa9-8d9c-e301c3278bad admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.940267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28571548-352b-4aa9-8d9c-e301c3278bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:06.942836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28571548-352b-4aa9-8d9c-e301c3278bad admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:06.966860 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1001/2009] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:06 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:06.970950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdd9c0-452d-4596-ac7b-86d5f05cd98a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:06.982758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdd9c0-452d-4596-ac7b-86d5f05cd98a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:06.989287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c992c0-7d7d-4244-849e-49308c7ae864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:06.989902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c992c0-7d7d-4244-849e-49308c7ae864 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:06.990180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c992c0-7d7d-4244-849e-49308c7ae864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:06.990453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c992c0-7d7d-4244-849e-49308c7ae864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:06.991461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c992c0-7d7d-4244-849e-49308c7ae864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:06.993472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c992c0-7d7d-4244-849e-49308c7ae864 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.006579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1009/2010] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:07.010637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28571548-352b-4aa9-8d9c-e301c3278bad admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.022914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28571548-352b-4aa9-8d9c-e301c3278bad admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.028810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d6d92-74a3-4546-9dcc-6de2c1c48236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.029234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6d92-74a3-4546-9dcc-6de2c1c48236 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.029514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6d92-74a3-4546-9dcc-6de2c1c48236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.029789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6d92-74a3-4546-9dcc-6de2c1c48236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.030439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6d92-74a3-4546-9dcc-6de2c1c48236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.032097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6d92-74a3-4546-9dcc-6de2c1c48236 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.049858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c992c0-7d7d-4244-849e-49308c7ae864 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.050506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1002/2011] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:07.062407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c992c0-7d7d-4244-849e-49308c7ae864 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.074548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c937a6-911a-44cf-9e14-7202139a5cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.075361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c937a6-911a-44cf-9e14-7202139a5cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.075764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c937a6-911a-44cf-9e14-7202139a5cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.076182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c937a6-911a-44cf-9e14-7202139a5cb7 admin admin] PATH_INFO: `/v3/projects/0373a79a88ae47558d3311b1d2684de3/users/ba614aed16be4536b6b01b93cfbeb962/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.092828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c937a6-911a-44cf-9e14-7202139a5cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0373a79a88ae47558d3311b1d2684de3, user_id=ba614aed16be4536b6b01b93cfbeb962, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.096385 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c937a6-911a-44cf-9e14-7202139a5cb7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.114360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1010/2012] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:07 2022] PUT /identity/v3/projects/0373a79a88ae47558d3311b1d2684de3/users/ba614aed16be4536b6b01b93cfbeb962/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:07.124772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d31b-2e37-4f32-8d27-18a79a9a6c22 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.125547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d31b-2e37-4f32-8d27-18a79a9a6c22 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.125654 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99598658-b3ba-437d-bfc0-1ea927632036 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.125866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d31b-2e37-4f32-8d27-18a79a9a6c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.126095 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99598658-b3ba-437d-bfc0-1ea927632036 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.126462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99598658-b3ba-437d-bfc0-1ea927632036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.150087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-3ef5d31b-2e37-4f32-8d27-18a79a9a6c22 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:07.151859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3ef5d31b-2e37-4f32-8d27-18a79a9a6c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:07.158841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-99598658-b3ba-437d-bfc0-1ea927632036 None None] MFA Rules not processed for user `ba614aed16be4536b6b01b93cfbeb962`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:07.160058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-99598658-b3ba-437d-bfc0-1ea927632036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:07.175018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:07.217003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1003/2013] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:07.240599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1011/2014] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:04:07.245921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5d31b-2e37-4f32-8d27-18a79a9a6c22 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.285081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99598658-b3ba-437d-bfc0-1ea927632036 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.286647 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-99598658-b3ba-437d-bfc0-1ea927632036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:07.327039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5d31b-2e37-4f32-8d27-18a79a9a6c22 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.333102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b5908-628f-45a7-8ca5-a5e33c712c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.333958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b5908-628f-45a7-8ca5-a5e33c712c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.334242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b5908-628f-45a7-8ca5-a5e33c712c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.334542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b5908-628f-45a7-8ca5-a5e33c712c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.335772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b5908-628f-45a7-8ca5-a5e33c712c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.337689 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b5908-628f-45a7-8ca5-a5e33c712c2a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.375067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1004/2015] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:07 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:04:07.376630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b5908-628f-45a7-8ca5-a5e33c712c2a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.385921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99598658-b3ba-437d-bfc0-1ea927632036 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.422978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:07.452746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b5908-628f-45a7-8ca5-a5e33c712c2a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.457786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cc7f8-0b52-4bba-ab80-dddcd1101fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.458717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc7f8-0b52-4bba-ab80-dddcd1101fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.459002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc7f8-0b52-4bba-ab80-dddcd1101fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.459404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc7f8-0b52-4bba-ab80-dddcd1101fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.460418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cc7f8-0b52-4bba-ab80-dddcd1101fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.461993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cc7f8-0b52-4bba-ab80-dddcd1101fe2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.462378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e225ac-61dd-457e-8332-fa500518acfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.463028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e225ac-61dd-457e-8332-fa500518acfe service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.463307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e225ac-61dd-457e-8332-fa500518acfe service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.463580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e225ac-61dd-457e-8332-fa500518acfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.488262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1005/2016] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:07 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:04:07.491728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cc7f8-0b52-4bba-ab80-dddcd1101fe2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.503679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cc7f8-0b52-4bba-ab80-dddcd1101fe2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.513414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc42530-dd26-449d-a8b4-dbab521b4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.514194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc42530-dd26-449d-a8b4-dbab521b4016 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.514558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc42530-dd26-449d-a8b4-dbab521b4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.514901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc42530-dd26-449d-a8b4-dbab521b4016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.515891 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc42530-dd26-449d-a8b4-dbab521b4016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.517750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc42530-dd26-449d-a8b4-dbab521b4016 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.531961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1006/2017] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:07.532177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e225ac-61dd-457e-8332-fa500518acfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.532177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e225ac-61dd-457e-8332-fa500518acfe service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.533135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc42530-dd26-449d-a8b4-dbab521b4016 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.541519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1012/2018] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:04:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 17:04:07.545556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc42530-dd26-449d-a8b4-dbab521b4016 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.553055 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070f09-ce8a-40d7-ae0b-6f19b2619566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.554039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070f09-ce8a-40d7-ae0b-6f19b2619566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.554321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070f09-ce8a-40d7-ae0b-6f19b2619566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.554634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070f09-ce8a-40d7-ae0b-6f19b2619566 admin admin] PATH_INFO: `/v3/projects/90c2bfc9fc4f458981d6c4142e877573/users/5afdbeecdcc1481ba824205b6af269e9/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.579902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a070f09-ce8a-40d7-ae0b-6f19b2619566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c2bfc9fc4f458981d6c4142e877573, user_id=5afdbeecdcc1481ba824205b6af269e9, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.590367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a070f09-ce8a-40d7-ae0b-6f19b2619566 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.618565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1007/2019] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:07 2022] PUT /identity/v3/projects/90c2bfc9fc4f458981d6c4142e877573/users/5afdbeecdcc1481ba824205b6af269e9/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:07.623419 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e225ac-61dd-457e-8332-fa500518acfe service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.640330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e225ac-61dd-457e-8332-fa500518acfe service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.715910 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae2b86-9f27-423d-b931-e15e14e77907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.716537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2b86-9f27-423d-b931-e15e14e77907 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.716821 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2b86-9f27-423d-b931-e15e14e77907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.717118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2b86-9f27-423d-b931-e15e14e77907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.717751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae2b86-9f27-423d-b931-e15e14e77907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.719613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae2b86-9f27-423d-b931-e15e14e77907 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.735907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1013/2020] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:07.737209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070f09-ce8a-40d7-ae0b-6f19b2619566 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:07.751030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070f09-ce8a-40d7-ae0b-6f19b2619566 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:07.759469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:07.760490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.761317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.761934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] PATH_INFO: `/v3/projects/90c2bfc9fc4f458981d6c4142e877573/users/5afdbeecdcc1481ba824205b6af269e9/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.765624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c2bfc9fc4f458981d6c4142e877573, user_id=5afdbeecdcc1481ba824205b6af269e9, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:07.768810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:07.777753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:07.797834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1008/2021] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:07 2022] PUT /identity/v3/projects/90c2bfc9fc4f458981d6c4142e877573/users/5afdbeecdcc1481ba824205b6af269e9/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:07.800414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a804a-5688-4b45-a43f-0832da3e0682 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:07.800706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a804a-5688-4b45-a43f-0832da3e0682 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:07.800987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a804a-5688-4b45-a43f-0832da3e0682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:07.866331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2e9a804a-5688-4b45-a43f-0832da3e0682 None None] MFA Rules not processed for user `5afdbeecdcc1481ba824205b6af269e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:07.867985 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2e9a804a-5688-4b45-a43f-0832da3e0682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:07.999780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:08.054294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1014/2022] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:08.062285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:08.064151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:08.093341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a804a-5688-4b45-a43f-0832da3e0682 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:08.097935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2e9a804a-5688-4b45-a43f-0832da3e0682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:08.197637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab28af-5a92-4301-882a-c65a2cb7816e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:08.202892 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dfa71-080c-412a-ba4a-7cb18eaa24ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:08.219727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dfa71-080c-412a-ba4a-7cb18eaa24ee service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:08.220091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dfa71-080c-412a-ba4a-7cb18eaa24ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:08.220331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dfa71-080c-412a-ba4a-7cb18eaa24ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:08.238562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dfa71-080c-412a-ba4a-7cb18eaa24ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:08.240710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dfa71-080c-412a-ba4a-7cb18eaa24ee service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:08.259715 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1009/2023] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:08.270060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a804a-5688-4b45-a43f-0832da3e0682 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:08.275681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:08.276296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:08.277319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:08.277856 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:08.279346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:08.408149 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dfa71-080c-412a-ba4a-7cb18eaa24ee service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:08.422044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dfa71-080c-412a-ba4a-7cb18eaa24ee service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:08.422990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:08.426360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:08.432765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c0700-686c-4090-a6b3-550d4a4cfd6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:08.434710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0700-686c-4090-a6b3-550d4a4cfd6c service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:08.435605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0700-686c-4090-a6b3-550d4a4cfd6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:08.436113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0700-686c-4090-a6b3-550d4a4cfd6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:08.450582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1015/2024] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:04:08.584740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c0700-686c-4090-a6b3-550d4a4cfd6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:08.586546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c0700-686c-4090-a6b3-550d4a4cfd6c service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:08.615815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1010/2025] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:04:18.441396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=59 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:18.467745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:18.469572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:18.539279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb9208-11f7-4bce-bef6-b3b108e4b3d0 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:18.543619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daa1c3-dc34-4eec-a79c-5dce41829efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:18.544399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa1c3-dc34-4eec-a79c-5dce41829efb service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:18.544686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa1c3-dc34-4eec-a79c-5dce41829efb service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:18.545032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa1c3-dc34-4eec-a79c-5dce41829efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:18.547262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-94daa1c3-dc34-4eec-a79c-5dce41829efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:18.558987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daa1c3-dc34-4eec-a79c-5dce41829efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:18.560528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daa1c3-dc34-4eec-a79c-5dce41829efb service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:18.569831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1016/2026] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:18.594544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=55 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:23.773465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f346-ba64-491d-9aec-c64401dc2947 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:23.774066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f346-ba64-491d-9aec-c64401dc2947 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:23.774066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8f346-ba64-491d-9aec-c64401dc2947 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:23.775584 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1011/2027] 10.222.0.27 () {54 vars in 921 bytes} [Mon Oct 10 17:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 17:04:23.782113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4de8d-9fb6-4a00-82db-363887d0c737 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:23.782570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4de8d-9fb6-4a00-82db-363887d0c737 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:23.782724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4de8d-9fb6-4a00-82db-363887d0c737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:23.802392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a5e4de8d-9fb6-4a00-82db-363887d0c737 None None] MFA Rules not processed for user `78b5bbfc207243febee44e0d7cacb7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:23.803561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a5e4de8d-9fb6-4a00-82db-363887d0c737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:23.813700 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1017/2028] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Oct 10 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:23.827004 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8f346-ba64-491d-9aec-c64401dc2947 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:23.828680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-74c8f346-ba64-491d-9aec-c64401dc2947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:23.894284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8f346-ba64-491d-9aec-c64401dc2947 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:23.898010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2d303-9474-4644-9a5a-2ae718b7263a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ede14ff816494505b20faba615bc5026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:23.898652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d303-9474-4644-9a5a-2ae718b7263a service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:23.898938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d303-9474-4644-9a5a-2ae718b7263a service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:23.899217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d303-9474-4644-9a5a-2ae718b7263a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:23.910556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2d303-9474-4644-9a5a-2ae718b7263a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:23.911998 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2d303-9474-4644-9a5a-2ae718b7263a service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:23.923033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1012/2029] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:24.115950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4de8d-9fb6-4a00-82db-363887d0c737 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:24.117333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a5e4de8d-9fb6-4a00-82db-363887d0c737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:24.187860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4de8d-9fb6-4a00-82db-363887d0c737 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:24.192743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:24.193345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:24.193631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:24.193903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:24.195617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:24.207209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:24.208790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:24.218979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1018/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:26.044447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbbf3d-0382-4ad2-a8af-b8c08d062edc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:26.044961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbbf3d-0382-4ad2-a8af-b8c08d062edc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:26.045142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbbf3d-0382-4ad2-a8af-b8c08d062edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:26.064654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-59cbbf3d-0382-4ad2-a8af-b8c08d062edc None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:26.065821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-59cbbf3d-0382-4ad2-a8af-b8c08d062edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:26.122631 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1013/2031] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:04:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:26.134827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:26.206128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddd462-bdd2-4d6f-b3fb-bcff13334da8 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:26.211197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985e2a9-d29d-4e6b-ab9e-bc0f3a307520 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:26.211805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e2a9-d29d-4e6b-ab9e-bc0f3a307520 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:26.212133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e2a9-d29d-4e6b-ab9e-bc0f3a307520 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:26.212408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e2a9-d29d-4e6b-ab9e-bc0f3a307520 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:26.221415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985e2a9-d29d-4e6b-ab9e-bc0f3a307520 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:26.223023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985e2a9-d29d-4e6b-ab9e-bc0f3a307520 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:26.231772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1019/2032] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:04:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:04:36.116549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=51 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:36.227811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:39.369432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbbf3d-0382-4ad2-a8af-b8c08d062edc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:39.434659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbbf3d-0382-4ad2-a8af-b8c08d062edc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:39.439069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:39.439695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:39.439968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:39.440237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] PATH_INFO: `/v3/users/ba614aed16be4536b6b01b93cfbeb962` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:39.441351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba614aed16be4536b6b01b93cfbeb962)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:39.443377 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:39.492220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba614aed16be4536b6b01b93cfbeb962'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:39.504838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba614aed16be4536b6b01b93cfbeb962'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:39.513617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba614aed16be4536b6b01b93cfbeb962'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:39.514331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba614aed16be4536b6b01b93cfbeb962'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:39.523405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba614aed16be4536b6b01b93cfbeb962'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:39.530477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1014/2033] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:39 2022] DELETE /identity/v3/users/ba614aed16be4536b6b01b93cfbeb962 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:39.535005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd967f1-417d-458f-b250-419c2de1f94b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:39.535456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd967f1-417d-458f-b250-419c2de1f94b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:39.535571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd967f1-417d-458f-b250-419c2de1f94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:39.554485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3bd967f1-417d-458f-b250-419c2de1f94b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:39.555688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3bd967f1-417d-458f-b250-419c2de1f94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:39.616472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1020/2034] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:39.626780 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:39.628152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:39.684430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c057d3-a719-4988-a261-c2b32c7c4e0c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:39.688035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2406a-91b1-40d2-adfb-a7cad4c9f2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:39.688632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2406a-91b1-40d2-adfb-a7cad4c9f2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:39.688936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2406a-91b1-40d2-adfb-a7cad4c9f2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:39.689219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2406a-91b1-40d2-adfb-a7cad4c9f2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:39.698419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2406a-91b1-40d2-adfb-a7cad4c9f2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:39.700384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2406a-91b1-40d2-adfb-a7cad4c9f2f2 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:39.709767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1015/2035] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:39.990208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd967f1-417d-458f-b250-419c2de1f94b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:39.991742 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3bd967f1-417d-458f-b250-419c2de1f94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:40.005845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd967f1-417d-458f-b250-419c2de1f94b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:40.010639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:40.011278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:40.011558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:40.013430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] PATH_INFO: `/v3/projects/0373a79a88ae47558d3311b1d2684de3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:40.014694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0373a79a88ae47558d3311b1d2684de3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:40.016646 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:40.067270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0373a79a88ae47558d3311b1d2684de3', 'request_id': 'req-ec155793-ec35-4144-922e-1fda52783211'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.073782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0373a79a88ae47558d3311b1d2684de3', 'request_id': 'req-ec155793-ec35-4144-922e-1fda52783211'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.080031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0373a79a88ae47558d3311b1d2684de3', 'request_id': 'req-ec155793-ec35-4144-922e-1fda52783211'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.093641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] The token cache is being invalidate because project 0373a79a88ae47558d3311b1d2684de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:04:40.094067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.094734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.096340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1021/2036] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:04:39 2022] DELETE /identity/v3/projects/0373a79a88ae47558d3311b1d2684de3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:40.100551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2406a-91b1-40d2-adfb-a7cad4c9f2f2 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:40.110498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2406a-91b1-40d2-adfb-a7cad4c9f2f2 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:40.130298 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:40.172313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:40.173109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:40.173384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:40.173653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] PATH_INFO: `/v3/users/5afdbeecdcc1481ba824205b6af269e9` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:40.174772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afdbeecdcc1481ba824205b6af269e9)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:40.176683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:40.223738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afdbeecdcc1481ba824205b6af269e9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.236212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afdbeecdcc1481ba824205b6af269e9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.244061 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afdbeecdcc1481ba824205b6af269e9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.244884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afdbeecdcc1481ba824205b6af269e9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.253711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d4a01d6c-cb0f-4093-91bd-7df9c48b1250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afdbeecdcc1481ba824205b6af269e9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.259837 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1016/2037] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:40 2022] DELETE /identity/v3/users/5afdbeecdcc1481ba824205b6af269e9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:40.531775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:40.533390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:40.546894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155793-ec35-4144-922e-1fda52783211 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:40.623132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:40.623831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:40.624127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:40.624397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] PATH_INFO: `/v3/projects/90c2bfc9fc4f458981d6c4142e877573` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:40.626135 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c2bfc9fc4f458981d6c4142e877573)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:40.627875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:40.665445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:40.705597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c2bfc9fc4f458981d6c4142e877573', 'request_id': 'req-76245e3b-17b2-4208-8c8c-dc754d655680'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.712015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c2bfc9fc4f458981d6c4142e877573', 'request_id': 'req-76245e3b-17b2-4208-8c8c-dc754d655680'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.719132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c2bfc9fc4f458981d6c4142e877573', 'request_id': 'req-76245e3b-17b2-4208-8c8c-dc754d655680'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.733811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] The token cache is being invalidate because project 90c2bfc9fc4f458981d6c4142e877573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:04:40.734107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.734795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76245e3b-17b2-4208-8c8c-dc754d655680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:40.736290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1022/2038] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:04:40 2022] DELETE /identity/v3/projects/90c2bfc9fc4f458981d6c4142e877573 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:40.741742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aae05-9393-4496-82c2-a6566517c93a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:40.742228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aae05-9393-4496-82c2-a6566517c93a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:40.742341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aae05-9393-4496-82c2-a6566517c93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:40.763165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-db9aae05-9393-4496-82c2-a6566517c93a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:40.764546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-db9aae05-9393-4496-82c2-a6566517c93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:40.822431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1017/2039] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:40.831832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4d6f-a2ba-48e6-826e-470907f5c499 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:40.832122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4d6f-a2ba-48e6-826e-470907f5c499 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:40.832400 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4d6f-a2ba-48e6-826e-470907f5c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:40.852579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e14a4d6f-a2ba-48e6-826e-470907f5c499 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:40.853779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e14a4d6f-a2ba-48e6-826e-470907f5c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:40.861755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1023/2040] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:40.866062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aae05-9393-4496-82c2-a6566517c93a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:40.876287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aae05-9393-4496-82c2-a6566517c93a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:40.881050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:40.881653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:40.881936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:40.882213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:40.882893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:04:40.883214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:40.884809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:40.897611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1018/2041] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:04:40.902091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a4d6f-a2ba-48e6-826e-470907f5c499 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:40.911453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a4d6f-a2ba-48e6-826e-470907f5c499 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:40.916024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0159bf-9f2f-4d35-b408-5233db0da312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:40.916621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0159bf-9f2f-4d35-b408-5233db0da312 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:40.916898 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0159bf-9f2f-4d35-b408-5233db0da312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:40.917166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0159bf-9f2f-4d35-b408-5233db0da312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:40.917809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0159bf-9f2f-4d35-b408-5233db0da312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:40.919775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0159bf-9f2f-4d35-b408-5233db0da312 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:40.946189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1024/2042] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:40 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:04:40.951298 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:40.961271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11af2-dabf-4644-975f-bf9ce0a7fbad admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:40.986693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:41.019873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276020e-5b6b-444c-9b6b-ff3788aa1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.020476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276020e-5b6b-444c-9b6b-ff3788aa1484 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.020758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276020e-5b6b-444c-9b6b-ff3788aa1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.021031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276020e-5b6b-444c-9b6b-ff3788aa1484 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.021655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276020e-5b6b-444c-9b6b-ff3788aa1484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.023607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276020e-5b6b-444c-9b6b-ff3788aa1484 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.044776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1019/2043] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:40 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:04:41.048809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0159bf-9f2f-4d35-b408-5233db0da312 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.059853 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0159bf-9f2f-4d35-b408-5233db0da312 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.064460 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde85c5-1b3d-4044-9864-c7bdeef0bb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.065050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde85c5-1b3d-4044-9864-c7bdeef0bb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.065331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde85c5-1b3d-4044-9864-c7bdeef0bb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.065606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde85c5-1b3d-4044-9864-c7bdeef0bb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.066238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde85c5-1b3d-4044-9864-c7bdeef0bb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.067873 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde85c5-1b3d-4044-9864-c7bdeef0bb5c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.077950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1025/2044] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:41.081932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276020e-5b6b-444c-9b6b-ff3788aa1484 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.092635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276020e-5b6b-444c-9b6b-ff3788aa1484 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.097191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1c139-338a-4cb5-bdce-aa6987982cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.097782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c139-338a-4cb5-bdce-aa6987982cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.098055 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c139-338a-4cb5-bdce-aa6987982cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.098327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c139-338a-4cb5-bdce-aa6987982cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.099014 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1c139-338a-4cb5-bdce-aa6987982cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.100578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1c139-338a-4cb5-bdce-aa6987982cdb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.112263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1020/2045] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:41.116378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde85c5-1b3d-4044-9864-c7bdeef0bb5c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.126219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde85c5-1b3d-4044-9864-c7bdeef0bb5c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.130774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846aa81-a414-4e77-9387-3895bd5b5f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.131410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846aa81-a414-4e77-9387-3895bd5b5f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.131688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846aa81-a414-4e77-9387-3895bd5b5f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.131965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846aa81-a414-4e77-9387-3895bd5b5f66 admin admin] PATH_INFO: `/v3/projects/f9e95ec398fb415aaed0143c4f4c4fe1/users/5993d16d312946b8b37bccf07f8d3716/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.146733 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846aa81-a414-4e77-9387-3895bd5b5f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e95ec398fb415aaed0143c4f4c4fe1, user_id=5993d16d312946b8b37bccf07f8d3716, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.149361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846aa81-a414-4e77-9387-3895bd5b5f66 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.162954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1026/2046] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:41 2022] PUT /identity/v3/projects/f9e95ec398fb415aaed0143c4f4c4fe1/users/5993d16d312946b8b37bccf07f8d3716/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:41.173873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02e73-64a4-4ebe-9375-82513b4152d6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.174157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02e73-64a4-4ebe-9375-82513b4152d6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.174431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02e73-64a4-4ebe-9375-82513b4152d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.202810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d6e02e73-64a4-4ebe-9375-82513b4152d6 None None] MFA Rules not processed for user `5993d16d312946b8b37bccf07f8d3716`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:41.203994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d6e02e73-64a4-4ebe-9375-82513b4152d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:41.267808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1021/2047] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:04:41.272338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846aa81-a414-4e77-9387-3895bd5b5f66 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.333294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846aa81-a414-4e77-9387-3895bd5b5f66 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.338094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18780f-e9cd-4181-b483-c0a5c8951232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.338729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18780f-e9cd-4181-b483-c0a5c8951232 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.339007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18780f-e9cd-4181-b483-c0a5c8951232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.339278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18780f-e9cd-4181-b483-c0a5c8951232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.340611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18780f-e9cd-4181-b483-c0a5c8951232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.342505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18780f-e9cd-4181-b483-c0a5c8951232 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.369133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1027/2048] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:41 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:41.373192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02e73-64a4-4ebe-9375-82513b4152d6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.383991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02e73-64a4-4ebe-9375-82513b4152d6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.445269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991a68e-bcf6-4861-ba87-1e376172eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.445879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a68e-bcf6-4861-ba87-1e376172eb1e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.446156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a68e-bcf6-4861-ba87-1e376172eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.446430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a68e-bcf6-4861-ba87-1e376172eb1e admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.447095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991a68e-bcf6-4861-ba87-1e376172eb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.449005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991a68e-bcf6-4861-ba87-1e376172eb1e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.471088 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1022/2049] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:41 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:41.475110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18780f-e9cd-4181-b483-c0a5c8951232 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.485536 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18780f-e9cd-4181-b483-c0a5c8951232 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.490318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b44c1-440c-4aef-9d01-6f70d43dc6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.490940 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b44c1-440c-4aef-9d01-6f70d43dc6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.491217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b44c1-440c-4aef-9d01-6f70d43dc6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.491509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b44c1-440c-4aef-9d01-6f70d43dc6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.492421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b44c1-440c-4aef-9d01-6f70d43dc6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.494178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b44c1-440c-4aef-9d01-6f70d43dc6e1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.504964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1028/2050] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:41.508969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991a68e-bcf6-4861-ba87-1e376172eb1e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.519234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991a68e-bcf6-4861-ba87-1e376172eb1e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.523699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf935d-106e-4790-ba05-daf4c00562eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.524336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf935d-106e-4790-ba05-daf4c00562eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.524625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf935d-106e-4790-ba05-daf4c00562eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.524889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf935d-106e-4790-ba05-daf4c00562eb admin admin] PATH_INFO: `/v3/projects/35538d2625a04e7ca3a8b1dc2b170d5a/users/7f4187f4652c4c7dbbc057b747940e97/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.539843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf935d-106e-4790-ba05-daf4c00562eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=35538d2625a04e7ca3a8b1dc2b170d5a, user_id=7f4187f4652c4c7dbbc057b747940e97, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.542463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf935d-106e-4790-ba05-daf4c00562eb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.554911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1023/2051] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:41 2022] PUT /identity/v3/projects/35538d2625a04e7ca3a8b1dc2b170d5a/users/7f4187f4652c4c7dbbc057b747940e97/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:41.559414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b44c1-440c-4aef-9d01-6f70d43dc6e1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.569292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b44c1-440c-4aef-9d01-6f70d43dc6e1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.589673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:41.631300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa79c4-0faf-4d35-a16c-8443fe643e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.631824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa79c4-0faf-4d35-a16c-8443fe643e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.632104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa79c4-0faf-4d35-a16c-8443fe643e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.632373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa79c4-0faf-4d35-a16c-8443fe643e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.633005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa79c4-0faf-4d35-a16c-8443fe643e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.634637 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa79c4-0faf-4d35-a16c-8443fe643e77 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.645244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1029/2052] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:41.649367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf935d-106e-4790-ba05-daf4c00562eb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.654966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:41.661087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf935d-106e-4790-ba05-daf4c00562eb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.665823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.666498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.666805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.667080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] PATH_INFO: `/v3/projects/35538d2625a04e7ca3a8b1dc2b170d5a/users/7f4187f4652c4c7dbbc057b747940e97/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.668956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35538d2625a04e7ca3a8b1dc2b170d5a, user_id=7f4187f4652c4c7dbbc057b747940e97, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.671632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.681587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1024/2053] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:41 2022] PUT /identity/v3/projects/35538d2625a04e7ca3a8b1dc2b170d5a/users/7f4187f4652c4c7dbbc057b747940e97/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:41.693812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb3829-a368-4c8a-8d06-de71165c8460 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.694312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb3829-a368-4c8a-8d06-de71165c8460 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.694839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb3829-a368-4c8a-8d06-de71165c8460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.725530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-68bb3829-a368-4c8a-8d06-de71165c8460 None None] MFA Rules not processed for user `7f4187f4652c4c7dbbc057b747940e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:41.726788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-68bb3829-a368-4c8a-8d06-de71165c8460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:41.799113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1030/2054] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:41.810354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:41.812178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:41.871786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa5c0d-568a-4f92-a732-00f27edd9470 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:41.875423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e378a9-91e4-4f1d-845f-ec8a5ab21ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:41.876048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e378a9-91e4-4f1d-845f-ec8a5ab21ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:41.876324 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e378a9-91e4-4f1d-845f-ec8a5ab21ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:41.876595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e378a9-91e4-4f1d-845f-ec8a5ab21ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:41.885645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e378a9-91e4-4f1d-845f-ec8a5ab21ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:41.887609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e378a9-91e4-4f1d-845f-ec8a5ab21ed4 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:41.897383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1025/2055] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:42.231623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb3829-a368-4c8a-8d06-de71165c8460 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:42.233023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-68bb3829-a368-4c8a-8d06-de71165c8460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:42.328524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb3829-a368-4c8a-8d06-de71165c8460 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:42.334550 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:42.335653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:42.335989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:42.336323 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:42.338289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:42.355641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:42.357226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:42.372580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1031/2056] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:43.283467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e378a9-91e4-4f1d-845f-ec8a5ab21ed4 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:43.346669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e378a9-91e4-4f1d-845f-ec8a5ab21ed4 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:43.351056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:43.351836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:43.352468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:43.352746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:43.353018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] PATH_INFO: `/v3/users/5993d16d312946b8b37bccf07f8d3716` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:43.354165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5993d16d312946b8b37bccf07f8d3716)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:43.357392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:43.363374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7722fcf-6c08-466c-b068-c30438e8d102 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:43.369000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:43.369711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:43.369994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:43.370275 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:43.372245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:43.406083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:43.409519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5993d16d312946b8b37bccf07f8d3716'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:43.423196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5993d16d312946b8b37bccf07f8d3716'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:43.430650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5993d16d312946b8b37bccf07f8d3716'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:43.431326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5993d16d312946b8b37bccf07f8d3716'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:43.436376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:43.437983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:43.439713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1504a0b9-c7aa-48bf-aa94-23cb87f977c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5993d16d312946b8b37bccf07f8d3716'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:43.446160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1026/2057] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:43 2022] DELETE /identity/v3/users/5993d16d312946b8b37bccf07f8d3716 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:43.450541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1032/2058] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:04:43.451184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60339b9b-809d-4258-acfc-bcb62a06dcaa None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:43.451529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60339b9b-809d-4258-acfc-bcb62a06dcaa None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:43.451870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60339b9b-809d-4258-acfc-bcb62a06dcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:43.471747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-60339b9b-809d-4258-acfc-bcb62a06dcaa None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:43.472920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-60339b9b-809d-4258-acfc-bcb62a06dcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:43.477872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:43.535311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1027/2059] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:43.545999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:43.547494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:43.606924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395d45-7351-42c0-86dc-1efa8eee6bb3 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:43.663448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ba4f-4f2d-42f3-9461-dfbad39e3fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:43.664051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ba4f-4f2d-42f3-9461-dfbad39e3fcd service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:43.664330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ba4f-4f2d-42f3-9461-dfbad39e3fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:43.664604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ba4f-4f2d-42f3-9461-dfbad39e3fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:43.676949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938ba4f-4f2d-42f3-9461-dfbad39e3fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:43.678569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938ba4f-4f2d-42f3-9461-dfbad39e3fcd service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:43.689623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1033/2060] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:43.982750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60339b9b-809d-4258-acfc-bcb62a06dcaa None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:43.984167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-60339b9b-809d-4258-acfc-bcb62a06dcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:43.997982 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60339b9b-809d-4258-acfc-bcb62a06dcaa None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:44.002749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:44.003406 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.003697 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.003954 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] PATH_INFO: `/v3/projects/f9e95ec398fb415aaed0143c4f4c4fe1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.005071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e95ec398fb415aaed0143c4f4c4fe1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:44.007009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:44.054253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e95ec398fb415aaed0143c4f4c4fe1', 'request_id': 'req-ba6af0a6-7f99-4eaf-a743-1577ff65c990'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.062947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e95ec398fb415aaed0143c4f4c4fe1', 'request_id': 'req-ba6af0a6-7f99-4eaf-a743-1577ff65c990'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.069097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e95ec398fb415aaed0143c4f4c4fe1', 'request_id': 'req-ba6af0a6-7f99-4eaf-a743-1577ff65c990'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.083297 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] The token cache is being invalidate because project f9e95ec398fb415aaed0143c4f4c4fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:04:44.083612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.084228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba6af0a6-7f99-4eaf-a743-1577ff65c990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.085805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1028/2061] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:04:43 2022] DELETE /identity/v3/projects/f9e95ec398fb415aaed0143c4f4c4fe1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:44.090325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ba4f-4f2d-42f3-9461-dfbad39e3fcd service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:44.100028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ba4f-4f2d-42f3-9461-dfbad39e3fcd service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:44.158265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:44.158922 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.159200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.159472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] PATH_INFO: `/v3/users/7f4187f4652c4c7dbbc057b747940e97` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.160584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4187f4652c4c7dbbc057b747940e97)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:44.162827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:44.203015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:44.216653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4187f4652c4c7dbbc057b747940e97'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.217351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4187f4652c4c7dbbc057b747940e97'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.224628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4187f4652c4c7dbbc057b747940e97'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.243668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4187f4652c4c7dbbc057b747940e97'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.244383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4187f4652c4c7dbbc057b747940e97'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.257872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1034/2062] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:44 2022] DELETE /identity/v3/users/7f4187f4652c4c7dbbc057b747940e97 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:44.504102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a98d-a0ac-4688-8749-6a1e377dc5d0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.504586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a98d-a0ac-4688-8749-6a1e377dc5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.504692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a98d-a0ac-4688-8749-6a1e377dc5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.525658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-de58a98d-a0ac-4688-8749-6a1e377dc5d0 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:44.526894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-de58a98d-a0ac-4688-8749-6a1e377dc5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:44.531811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:44.534108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:44.594118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1029/2063] 10.222.0.27 () {58 vars in 967 bytes} [Mon Oct 10 17:04:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:44.603619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6021eb-fb1f-4126-880a-2c8bbc3dc642 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:44.609426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:44.609592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a98d-a0ac-4688-8749-6a1e377dc5d0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:44.610060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.610338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.610642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] PATH_INFO: `/v3/projects/35538d2625a04e7ca3a8b1dc2b170d5a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.611067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-de58a98d-a0ac-4688-8749-6a1e377dc5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:44.612090 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35538d2625a04e7ca3a8b1dc2b170d5a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:44.614035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:44.655384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:44.664996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35538d2625a04e7ca3a8b1dc2b170d5a', 'request_id': 'req-bbb435f8-9721-45d4-a462-414b359e08f4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.671273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35538d2625a04e7ca3a8b1dc2b170d5a', 'request_id': 'req-bbb435f8-9721-45d4-a462-414b359e08f4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.677188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35538d2625a04e7ca3a8b1dc2b170d5a', 'request_id': 'req-bbb435f8-9721-45d4-a462-414b359e08f4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.684719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a98d-a0ac-4688-8749-6a1e377dc5d0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:44.690967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] The token cache is being invalidate because project 35538d2625a04e7ca3a8b1dc2b170d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:04:44.691243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.691855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bbb435f8-9721-45d4-a462-414b359e08f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:44.693323 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1035/2064] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:04:44 2022] DELETE /identity/v3/projects/35538d2625a04e7ca3a8b1dc2b170d5a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:04:44.698339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791713da-dbb1-4a1b-8455-76c952b48629 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.698642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791713da-dbb1-4a1b-8455-76c952b48629 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.698917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791713da-dbb1-4a1b-8455-76c952b48629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.718994 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-791713da-dbb1-4a1b-8455-76c952b48629 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:44.720182 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-791713da-dbb1-4a1b-8455-76c952b48629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:44.750710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:44.751333 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.751691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.751959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.753753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:44.755339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:44.789091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1036/2065] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:04:44.797763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592496d-2fd4-4297-8a92-67a5d05a083a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.798050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592496d-2fd4-4297-8a92-67a5d05a083a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.798325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592496d-2fd4-4297-8a92-67a5d05a083a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.819965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1592496d-2fd4-4297-8a92-67a5d05a083a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:44.820748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:44.821187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1592496d-2fd4-4297-8a92-67a5d05a083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:44.822597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:44.831067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1037/2066] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:04:44.835053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592496d-2fd4-4297-8a92-67a5d05a083a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:44.843707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1030/2067] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:04:44.847502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592496d-2fd4-4297-8a92-67a5d05a083a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:44.852745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:44.853657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.853975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.854339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.855147 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:04:44.855592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:44.857379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:44.872831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1038/2068] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:04:44.876723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:44.888068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ebd4f-fd9b-466f-b645-9b661409d42f service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:44.893879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a6d8b-6d00-4236-b722-9e035c2f1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:44.894486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a6d8b-6d00-4236-b722-9e035c2f1f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:44.894790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a6d8b-6d00-4236-b722-9e035c2f1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:44.897079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a6d8b-6d00-4236-b722-9e035c2f1f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:44.897546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a6d8b-6d00-4236-b722-9e035c2f1f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:44.899491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a6d8b-6d00-4236-b722-9e035c2f1f24 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:44.932409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1031/2069] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:44 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:44.936889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:44.947082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c0b79-10d8-402b-8f6f-b0967c07d531 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:45.012076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776dac0-97ff-4b1d-a95a-48dc45830689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:45.012786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776dac0-97ff-4b1d-a95a-48dc45830689 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.013061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776dac0-97ff-4b1d-a95a-48dc45830689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.013426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776dac0-97ff-4b1d-a95a-48dc45830689 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.014061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776dac0-97ff-4b1d-a95a-48dc45830689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:45.016163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776dac0-97ff-4b1d-a95a-48dc45830689 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:45.045345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1039/2070] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:44 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:45.049232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a6d8b-6d00-4236-b722-9e035c2f1f24 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:45.062804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a6d8b-6d00-4236-b722-9e035c2f1f24 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:45.068848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd46a8-0feb-4ac9-8596-2423649f8f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:45.069808 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd46a8-0feb-4ac9-8596-2423649f8f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.070052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd46a8-0feb-4ac9-8596-2423649f8f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.070385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd46a8-0feb-4ac9-8596-2423649f8f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.071442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd46a8-0feb-4ac9-8596-2423649f8f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:45.073731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd46a8-0feb-4ac9-8596-2423649f8f61 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:45.088584 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1032/2071] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:45.093701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776dac0-97ff-4b1d-a95a-48dc45830689 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:45.106223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776dac0-97ff-4b1d-a95a-48dc45830689 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:45.112162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278b40a-ba55-40e2-b83d-afa8585810e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:45.112955 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b40a-ba55-40e2-b83d-afa8585810e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.113276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b40a-ba55-40e2-b83d-afa8585810e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.113555 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b40a-ba55-40e2-b83d-afa8585810e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.114206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278b40a-ba55-40e2-b83d-afa8585810e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:45.115838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278b40a-ba55-40e2-b83d-afa8585810e3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:45.134968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1040/2072] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:45.140392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd46a8-0feb-4ac9-8596-2423649f8f61 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:45.154966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd46a8-0feb-4ac9-8596-2423649f8f61 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:45.160212 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:45.160952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.161451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.161779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] PATH_INFO: `/v3/projects/5677952d56aa42d9aa417fe9020dfc52/users/11452585c33447e88d29b2421a13d726/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.180663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5677952d56aa42d9aa417fe9020dfc52, user_id=11452585c33447e88d29b2421a13d726, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:45.184144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:45.199766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1033/2073] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:45 2022] PUT /identity/v3/projects/5677952d56aa42d9aa417fe9020dfc52/users/11452585c33447e88d29b2421a13d726/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:45.210061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d94b-88a2-4517-8451-cc1cc127d4d4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.210424 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d94b-88a2-4517-8451-cc1cc127d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.210652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d94b-88a2-4517-8451-cc1cc127d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.251039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1fa9d94b-88a2-4517-8451-cc1cc127d4d4 None None] MFA Rules not processed for user `11452585c33447e88d29b2421a13d726`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:45.252488 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1fa9d94b-88a2-4517-8451-cc1cc127d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:45.335782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1041/2074] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:45.353663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:45.357134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:45.418881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:45.446613 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96fc8-765a-4c65-b5d4-18731c910e84 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:45.451444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dc7b8-6c0a-43ed-ac7f-6126aa0f9080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:45.452049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc7b8-6c0a-43ed-ac7f-6126aa0f9080 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.452328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc7b8-6c0a-43ed-ac7f-6126aa0f9080 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.452622 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc7b8-6c0a-43ed-ac7f-6126aa0f9080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.461205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0dc7b8-6c0a-43ed-ac7f-6126aa0f9080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:45.462705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0dc7b8-6c0a-43ed-ac7f-6126aa0f9080 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:45.472309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1034/2075] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:45.493191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d94b-88a2-4517-8451-cc1cc127d4d4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:45.530009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:45.568747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d94b-88a2-4517-8451-cc1cc127d4d4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:45.575393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:45.576043 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.576512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.576687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] PATH_INFO: `/v3/users/11452585c33447e88d29b2421a13d726` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.577761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11452585c33447e88d29b2421a13d726)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:45.579717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:45.639433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11452585c33447e88d29b2421a13d726'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:45.640096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11452585c33447e88d29b2421a13d726'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:45.647065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11452585c33447e88d29b2421a13d726'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:45.659013 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11452585c33447e88d29b2421a13d726'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:45.659660 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11452585c33447e88d29b2421a13d726'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:45.672069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1042/2076] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:45 2022] DELETE /identity/v3/users/11452585c33447e88d29b2421a13d726 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:45.676582 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c041d7-d2c3-451e-a264-0a8a82ee934a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.677075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c041d7-d2c3-451e-a264-0a8a82ee934a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.677203 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c041d7-d2c3-451e-a264-0a8a82ee934a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.696189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-80c041d7-d2c3-451e-a264-0a8a82ee934a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:45.697373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-80c041d7-d2c3-451e-a264-0a8a82ee934a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:45.756777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1035/2077] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:45.767500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:45.769657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:45.830368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61821cf0-b4a1-431c-8d1f-3813012f5127 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:45.833931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5a363-7a6b-4a2a-88e4-cf303dc45ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:45.834548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a363-7a6b-4a2a-88e4-cf303dc45ccd service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:45.834834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a363-7a6b-4a2a-88e4-cf303dc45ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:45.835110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a363-7a6b-4a2a-88e4-cf303dc45ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:45.844895 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5a363-7a6b-4a2a-88e4-cf303dc45ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:45.846324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5a363-7a6b-4a2a-88e4-cf303dc45ccd service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:45.855819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1043/2078] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:46.144743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c041d7-d2c3-451e-a264-0a8a82ee934a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.146325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-80c041d7-d2c3-451e-a264-0a8a82ee934a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:46.161411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c041d7-d2c3-451e-a264-0a8a82ee934a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.167558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.169057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.169440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.169587 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] PATH_INFO: `/v3/projects/5677952d56aa42d9aa417fe9020dfc52` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.170836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5677952d56aa42d9aa417fe9020dfc52)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.172750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:46.218451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5677952d56aa42d9aa417fe9020dfc52', 'request_id': 'req-16cf4152-0ec2-4851-9654-68214b2ba5ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:46.224590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5677952d56aa42d9aa417fe9020dfc52', 'request_id': 'req-16cf4152-0ec2-4851-9654-68214b2ba5ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:46.230103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5677952d56aa42d9aa417fe9020dfc52', 'request_id': 'req-16cf4152-0ec2-4851-9654-68214b2ba5ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:46.243018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] The token cache is being invalidate because project 5677952d56aa42d9aa417fe9020dfc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:04:46.243310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:46.243960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-16cf4152-0ec2-4851-9654-68214b2ba5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:46.245434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1036/2079] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:04:46 2022] DELETE /identity/v3/projects/5677952d56aa42d9aa417fe9020dfc52 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:46.250717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b6c3-366f-49f2-83ac-88b1d2e575a3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.251005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b6c3-366f-49f2-83ac-88b1d2e575a3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.251277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5b6c3-366f-49f2-83ac-88b1d2e575a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.271236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d3e5b6c3-366f-49f2-83ac-88b1d2e575a3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:46.272425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d3e5b6c3-366f-49f2-83ac-88b1d2e575a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:46.318320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:46.336123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1044/2080] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:46.344397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0723d3-385d-48ec-aa9c-dea47e9ed95b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.344621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0723d3-385d-48ec-aa9c-dea47e9ed95b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.344894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0723d3-385d-48ec-aa9c-dea47e9ed95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.366146 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-df0723d3-385d-48ec-aa9c-dea47e9ed95b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:46.367369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-df0723d3-385d-48ec-aa9c-dea47e9ed95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:46.375563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1037/2081] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:46.379846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5b6c3-366f-49f2-83ac-88b1d2e575a3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.389906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5b6c3-366f-49f2-83ac-88b1d2e575a3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.394561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.395171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.395628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.395855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.396509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:04:46.396815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.398388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:46.411917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1045/2082] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:04:46.415962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0723d3-385d-48ec-aa9c-dea47e9ed95b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.425749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0723d3-385d-48ec-aa9c-dea47e9ed95b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.430506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e21355-177e-4969-bf39-3775ab2948eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.431214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21355-177e-4969-bf39-3775ab2948eb admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.431497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21355-177e-4969-bf39-3775ab2948eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.431769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21355-177e-4969-bf39-3775ab2948eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.432398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e21355-177e-4969-bf39-3775ab2948eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.434338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e21355-177e-4969-bf39-3775ab2948eb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:46.463694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1038/2083] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:46 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:46.468128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.479333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345b66-5751-4d2f-a298-5ff0e75324bb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.546365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81a5f-066f-4cc7-a340-7098562086f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.547126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81a5f-066f-4cc7-a340-7098562086f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.547410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81a5f-066f-4cc7-a340-7098562086f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.547798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81a5f-066f-4cc7-a340-7098562086f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.548437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a81a5f-066f-4cc7-a340-7098562086f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.551229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a81a5f-066f-4cc7-a340-7098562086f4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:46.574490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1046/2084] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:46 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:04:46.578422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e21355-177e-4969-bf39-3775ab2948eb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.590498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e21355-177e-4969-bf39-3775ab2948eb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.595726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43ff9d-8ef3-4d76-8f54-8f40ec7c6567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.596242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43ff9d-8ef3-4d76-8f54-8f40ec7c6567 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.597065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43ff9d-8ef3-4d76-8f54-8f40ec7c6567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.597306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43ff9d-8ef3-4d76-8f54-8f40ec7c6567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.598163 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43ff9d-8ef3-4d76-8f54-8f40ec7c6567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.600114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43ff9d-8ef3-4d76-8f54-8f40ec7c6567 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:46.613740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1039/2085] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:46.617976 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81a5f-066f-4cc7-a340-7098562086f4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.629074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81a5f-066f-4cc7-a340-7098562086f4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.633644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1747-9fef-4056-adc6-4cf9234d5bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.634238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1747-9fef-4056-adc6-4cf9234d5bda admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.634511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1747-9fef-4056-adc6-4cf9234d5bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.634813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1747-9fef-4056-adc6-4cf9234d5bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.636073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed1747-9fef-4056-adc6-4cf9234d5bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.637923 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed1747-9fef-4056-adc6-4cf9234d5bda admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:46.649798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1047/2086] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:46.654359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43ff9d-8ef3-4d76-8f54-8f40ec7c6567 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.664771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43ff9d-8ef3-4d76-8f54-8f40ec7c6567 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.670101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5bae7-ca54-4888-9bba-9ab2590d45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.670771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5bae7-ca54-4888-9bba-9ab2590d45af admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.671049 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5bae7-ca54-4888-9bba-9ab2590d45af admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.671319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5bae7-ca54-4888-9bba-9ab2590d45af admin admin] PATH_INFO: `/v3/projects/68321ff114684c64ba6b4adde103bdaa/users/0ad27b184a2c4322a3906c33127df0e2/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.682938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:46.687968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5bae7-ca54-4888-9bba-9ab2590d45af admin admin] RBAC: Authorizing `identity:create_grant(project_id=68321ff114684c64ba6b4adde103bdaa, user_id=0ad27b184a2c4322a3906c33127df0e2, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.691083 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5bae7-ca54-4888-9bba-9ab2590d45af admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:46.705254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1040/2087] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:46 2022] PUT /identity/v3/projects/68321ff114684c64ba6b4adde103bdaa/users/0ad27b184a2c4322a3906c33127df0e2/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:46.716903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f69c-1558-4e2a-b323-8e32ae299449 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.717187 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f69c-1558-4e2a-b323-8e32ae299449 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.717462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f69c-1558-4e2a-b323-8e32ae299449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.745111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5387f69c-1558-4e2a-b323-8e32ae299449 None None] MFA Rules not processed for user `0ad27b184a2c4322a3906c33127df0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:46.746410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5387f69c-1558-4e2a-b323-8e32ae299449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:46.810524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1048/2088] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:04:46.815011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5bae7-ca54-4888-9bba-9ab2590d45af admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.876980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5bae7-ca54-4888-9bba-9ab2590d45af admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.881607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94205-0edf-4b6a-9f92-0e1b581d5283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.882204 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94205-0edf-4b6a-9f92-0e1b581d5283 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.882482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94205-0edf-4b6a-9f92-0e1b581d5283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.882793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94205-0edf-4b6a-9f92-0e1b581d5283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.883427 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c94205-0edf-4b6a-9f92-0e1b581d5283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.885328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c94205-0edf-4b6a-9f92-0e1b581d5283 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:46.912347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1041/2089] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:46 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:46.916433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f69c-1558-4e2a-b323-8e32ae299449 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:46.927697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f69c-1558-4e2a-b323-8e32ae299449 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:46.970269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:46.986396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3e04f-cf05-4d39-93ed-7f7c5a171546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:46.987291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3e04f-cf05-4d39-93ed-7f7c5a171546 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:46.987572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3e04f-cf05-4d39-93ed-7f7c5a171546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:46.987848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3e04f-cf05-4d39-93ed-7f7c5a171546 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:46.988513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3e04f-cf05-4d39-93ed-7f7c5a171546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:46.990427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3e04f-cf05-4d39-93ed-7f7c5a171546 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:47.012133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1049/2090] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:46 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:47.016218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94205-0edf-4b6a-9f92-0e1b581d5283 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:47.026170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94205-0edf-4b6a-9f92-0e1b581d5283 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:47.030910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a415db-775f-4389-90cd-192c89732ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:47.031498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a415db-775f-4389-90cd-192c89732ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:47.031774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a415db-775f-4389-90cd-192c89732ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:47.032043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a415db-775f-4389-90cd-192c89732ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:47.032671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a415db-775f-4389-90cd-192c89732ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:47.034247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a415db-775f-4389-90cd-192c89732ca5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:47.045866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1042/2091] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:47.049870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3e04f-cf05-4d39-93ed-7f7c5a171546 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:47.060506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3e04f-cf05-4d39-93ed-7f7c5a171546 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:47.065101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc96359-5418-4059-923b-107332cc716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:47.065735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc96359-5418-4059-923b-107332cc716c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:47.066016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc96359-5418-4059-923b-107332cc716c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:47.066290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc96359-5418-4059-923b-107332cc716c admin admin] PATH_INFO: `/v3/projects/3ff5ba7b28b34c03b6a5fb52485e60d4/users/696fd24d000145c5ad686bd63f9f7d7f/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:47.081543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc96359-5418-4059-923b-107332cc716c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff5ba7b28b34c03b6a5fb52485e60d4, user_id=696fd24d000145c5ad686bd63f9f7d7f, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:47.084260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc96359-5418-4059-923b-107332cc716c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:47.098238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1050/2092] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:47 2022] PUT /identity/v3/projects/3ff5ba7b28b34c03b6a5fb52485e60d4/users/696fd24d000145c5ad686bd63f9f7d7f/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:47.102332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a415db-775f-4389-90cd-192c89732ca5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:47.113259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a415db-775f-4389-90cd-192c89732ca5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:47.168685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39fa1a-2d1d-4044-9c8f-f9d8cfdf586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:47.169276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fa1a-2d1d-4044-9c8f-f9d8cfdf586c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:47.169552 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fa1a-2d1d-4044-9c8f-f9d8cfdf586c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:47.169817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fa1a-2d1d-4044-9c8f-f9d8cfdf586c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:47.170439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39fa1a-2d1d-4044-9c8f-f9d8cfdf586c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:47.172041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39fa1a-2d1d-4044-9c8f-f9d8cfdf586c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:47.181534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1043/2093] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:47.185800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc96359-5418-4059-923b-107332cc716c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:47.196106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc96359-5418-4059-923b-107332cc716c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:47.201356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:47.201987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:47.202270 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:47.202572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] PATH_INFO: `/v3/projects/3ff5ba7b28b34c03b6a5fb52485e60d4/users/696fd24d000145c5ad686bd63f9f7d7f/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:47.204489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff5ba7b28b34c03b6a5fb52485e60d4, user_id=696fd24d000145c5ad686bd63f9f7d7f, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:47.207223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:47.217934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1051/2094] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:47 2022] PUT /identity/v3/projects/3ff5ba7b28b34c03b6a5fb52485e60d4/users/696fd24d000145c5ad686bd63f9f7d7f/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:47.227941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7940c-8ec9-4924-b295-a56f04c675bc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:47.228227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7940c-8ec9-4924-b295-a56f04c675bc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:47.228524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7940c-8ec9-4924-b295-a56f04c675bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:47.255893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-21c7940c-8ec9-4924-b295-a56f04c675bc None None] MFA Rules not processed for user `696fd24d000145c5ad686bd63f9f7d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:47.257130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-21c7940c-8ec9-4924-b295-a56f04c675bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:47.303713 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:47.327994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1044/2095] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:47.338889 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:47.341686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:47.405755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80ed0e-960c-4b4d-9c09-d722cf589b90 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:47.409472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd092c-5d08-4e43-be0b-607345779f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:47.409998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd092c-5d08-4e43-be0b-607345779f27 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:47.410594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd092c-5d08-4e43-be0b-607345779f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:47.410594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd092c-5d08-4e43-be0b-607345779f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:47.468746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd092c-5d08-4e43-be0b-607345779f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:47.470248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd092c-5d08-4e43-be0b-607345779f27 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:47.479547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1052/2096] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:50.067980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7940c-8ec9-4924-b295-a56f04c675bc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:50.128866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7940c-8ec9-4924-b295-a56f04c675bc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:50.133303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:50.133921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:50.134200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:50.134474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] PATH_INFO: `/v3/users/0ad27b184a2c4322a3906c33127df0e2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:50.135606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad27b184a2c4322a3906c33127df0e2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:50.137752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:50.182030 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad27b184a2c4322a3906c33127df0e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.193422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad27b184a2c4322a3906c33127df0e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.200604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad27b184a2c4322a3906c33127df0e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.201414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad27b184a2c4322a3906c33127df0e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.207878 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad27b184a2c4322a3906c33127df0e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.213865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1045/2097] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:50 2022] DELETE /identity/v3/users/0ad27b184a2c4322a3906c33127df0e2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:50.219028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac29b7-31e7-4ef5-be8b-3fd452cb7585 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:50.219492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac29b7-31e7-4ef5-be8b-3fd452cb7585 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:50.219624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac29b7-31e7-4ef5-be8b-3fd452cb7585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:50.238817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-03ac29b7-31e7-4ef5-be8b-3fd452cb7585 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:50.240011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-03ac29b7-31e7-4ef5-be8b-3fd452cb7585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:50.284512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:50.299390 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1053/2098] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:50.309557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:50.311033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:50.368031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16d05b-aae4-44f9-85b6-22367ed637a4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:50.371961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c7699-d67c-4a94-a5c2-a6a002da92c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:50.372562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c7699-d67c-4a94-a5c2-a6a002da92c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:50.372839 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c7699-d67c-4a94-a5c2-a6a002da92c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:50.373110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c7699-d67c-4a94-a5c2-a6a002da92c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:50.382210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c7699-d67c-4a94-a5c2-a6a002da92c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:50.383666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c7699-d67c-4a94-a5c2-a6a002da92c2 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:50.393625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1046/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:50.669902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac29b7-31e7-4ef5-be8b-3fd452cb7585 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:50.671468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-03ac29b7-31e7-4ef5-be8b-3fd452cb7585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:50.687155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac29b7-31e7-4ef5-be8b-3fd452cb7585 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:50.692597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:50.693478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:50.693764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:50.694136 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] PATH_INFO: `/v3/projects/68321ff114684c64ba6b4adde103bdaa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:50.696470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68321ff114684c64ba6b4adde103bdaa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:50.700106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:50.749706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68321ff114684c64ba6b4adde103bdaa', 'request_id': 'req-239b0a4e-67e8-41ee-a133-eee50f0ad68d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.755967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68321ff114684c64ba6b4adde103bdaa', 'request_id': 'req-239b0a4e-67e8-41ee-a133-eee50f0ad68d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.762418 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68321ff114684c64ba6b4adde103bdaa', 'request_id': 'req-239b0a4e-67e8-41ee-a133-eee50f0ad68d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.775903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] The token cache is being invalidate because project 68321ff114684c64ba6b4adde103bdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:04:50.776191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.776803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.778749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1054/2100] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:04:50 2022] DELETE /identity/v3/projects/68321ff114684c64ba6b4adde103bdaa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:50.782693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c7699-d67c-4a94-a5c2-a6a002da92c2 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:50.792117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c7699-d67c-4a94-a5c2-a6a002da92c2 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:50.795663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:50.849170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:50.849782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:50.850058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:50.850325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] PATH_INFO: `/v3/users/696fd24d000145c5ad686bd63f9f7d7f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:50.851532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696fd24d000145c5ad686bd63f9f7d7f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:50.853435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:50.899784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696fd24d000145c5ad686bd63f9f7d7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.912294 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696fd24d000145c5ad686bd63f9f7d7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.919100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696fd24d000145c5ad686bd63f9f7d7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.919767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696fd24d000145c5ad686bd63f9f7d7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.926722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4fc91a29-f479-4c60-994b-a3d52635bd23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696fd24d000145c5ad686bd63f9f7d7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:50.932499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1047/2101] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:50 2022] DELETE /identity/v3/users/696fd24d000145c5ad686bd63f9f7d7f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:51.197632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:51.200260 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:51.213715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b0a4e-67e8-41ee-a133-eee50f0ad68d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:51.272492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:51.273222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.273387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.273657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] PATH_INFO: `/v3/projects/3ff5ba7b28b34c03b6a5fb52485e60d4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.274811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff5ba7b28b34c03b6a5fb52485e60d4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:51.276702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:51.327389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff5ba7b28b34c03b6a5fb52485e60d4', 'request_id': 'req-bc0ea547-13cf-4bbf-b346-167353d1c265'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:51.334084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff5ba7b28b34c03b6a5fb52485e60d4', 'request_id': 'req-bc0ea547-13cf-4bbf-b346-167353d1c265'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:51.340287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff5ba7b28b34c03b6a5fb52485e60d4', 'request_id': 'req-bc0ea547-13cf-4bbf-b346-167353d1c265'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:51.352655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] The token cache is being invalidate because project 3ff5ba7b28b34c03b6a5fb52485e60d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:04:51.352946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:51.353563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bc0ea547-13cf-4bbf-b346-167353d1c265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:51.355111 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1055/2102] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:04:51 2022] DELETE /identity/v3/projects/3ff5ba7b28b34c03b6a5fb52485e60d4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:51.360315 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3f77-6c24-4946-810d-3066431ddb7f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.360792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3f77-6c24-4946-810d-3066431ddb7f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.360888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3f77-6c24-4946-810d-3066431ddb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.380960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-eb1a3f77-6c24-4946-810d-3066431ddb7f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:51.382197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-eb1a3f77-6c24-4946-810d-3066431ddb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:51.461403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1048/2103] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:51.470265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e711a3-8138-4088-8665-6b7dcdd45bf8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.470679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e711a3-8138-4088-8665-6b7dcdd45bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.471011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e711a3-8138-4088-8665-6b7dcdd45bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.481238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:51.504472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-95e711a3-8138-4088-8665-6b7dcdd45bf8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:51.505709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-95e711a3-8138-4088-8665-6b7dcdd45bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:51.514974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1056/2104] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:04:51.519307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a3f77-6c24-4946-810d-3066431ddb7f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:51.529345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a3f77-6c24-4946-810d-3066431ddb7f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:51.535567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:51.536226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.536572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.536917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.537731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:04:51.538509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:51.539580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:51.552787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1049/2105] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:04:51.557014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e711a3-8138-4088-8665-6b7dcdd45bf8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:51.567472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e711a3-8138-4088-8665-6b7dcdd45bf8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:51.572761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80ffa6-18e2-44e9-8550-8acb86cf6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:51.573532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80ffa6-18e2-44e9-8550-8acb86cf6cae admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.574360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80ffa6-18e2-44e9-8550-8acb86cf6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.574857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80ffa6-18e2-44e9-8550-8acb86cf6cae admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.575537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80ffa6-18e2-44e9-8550-8acb86cf6cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:51.577510 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80ffa6-18e2-44e9-8550-8acb86cf6cae admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:51.613936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1057/2106] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:51 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:04:51.615165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:51.625763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817ef1d-c96e-4fe3-a2a1-1253bddb131b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:51.635317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:51.691881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b644e-53b6-4264-8f91-cef82b4b03f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:51.692802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b644e-53b6-4264-8f91-cef82b4b03f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.693087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b644e-53b6-4264-8f91-cef82b4b03f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.693366 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b644e-53b6-4264-8f91-cef82b4b03f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.694004 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b644e-53b6-4264-8f91-cef82b4b03f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:51.695967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b644e-53b6-4264-8f91-cef82b4b03f4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:51.721264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1050/2107] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:51 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:51.725177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80ffa6-18e2-44e9-8550-8acb86cf6cae admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:51.741586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80ffa6-18e2-44e9-8550-8acb86cf6cae admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:51.749229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20aec-3915-42aa-8631-fc864e38f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:51.749939 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20aec-3915-42aa-8631-fc864e38f659 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.750198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20aec-3915-42aa-8631-fc864e38f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.750483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20aec-3915-42aa-8631-fc864e38f659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.751190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a20aec-3915-42aa-8631-fc864e38f659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:51.752863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a20aec-3915-42aa-8631-fc864e38f659 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:51.764839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1058/2108] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:51.768821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b644e-53b6-4264-8f91-cef82b4b03f4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:51.779664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b644e-53b6-4264-8f91-cef82b4b03f4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:51.784537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80e64-6286-4f89-a196-27ef1d9ecc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:51.785139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80e64-6286-4f89-a196-27ef1d9ecc4e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.785421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80e64-6286-4f89-a196-27ef1d9ecc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.785699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80e64-6286-4f89-a196-27ef1d9ecc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.786345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac80e64-6286-4f89-a196-27ef1d9ecc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:51.788588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac80e64-6286-4f89-a196-27ef1d9ecc4e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:51.805265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1051/2109] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:51.814278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20aec-3915-42aa-8631-fc864e38f659 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:51.833148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20aec-3915-42aa-8631-fc864e38f659 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:51.839007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f967-7966-4c54-abf6-6ed637133d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:51.840302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f967-7966-4c54-abf6-6ed637133d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.840590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f967-7966-4c54-abf6-6ed637133d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.841515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f967-7966-4c54-abf6-6ed637133d3a admin admin] PATH_INFO: `/v3/projects/e077f33b7e2743318d51fee9ba734b5e/users/34efd32e7cec46aab268702ad4afe752/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.865240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91f967-7966-4c54-abf6-6ed637133d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e077f33b7e2743318d51fee9ba734b5e, user_id=34efd32e7cec46aab268702ad4afe752, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:51.868233 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91f967-7966-4c54-abf6-6ed637133d3a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:51.882241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1059/2110] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:51 2022] PUT /identity/v3/projects/e077f33b7e2743318d51fee9ba734b5e/users/34efd32e7cec46aab268702ad4afe752/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:51.895256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a393f0-7fd0-47c9-b3b7-06ed574ef808 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:51.895557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a393f0-7fd0-47c9-b3b7-06ed574ef808 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:51.895914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a393f0-7fd0-47c9-b3b7-06ed574ef808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:51.925112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-13a393f0-7fd0-47c9-b3b7-06ed574ef808 None None] MFA Rules not processed for user `34efd32e7cec46aab268702ad4afe752`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:51.926334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-13a393f0-7fd0-47c9-b3b7-06ed574ef808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:51.996000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1052/2111] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:51.999282 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f967-7966-4c54-abf6-6ed637133d3a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.063080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f967-7966-4c54-abf6-6ed637133d3a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.067728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.068324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.068600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.068872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.069498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.071430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.100644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1060/2112] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:51 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:04:52.104550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a393f0-7fd0-47c9-b3b7-06ed574ef808 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.116377 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a393f0-7fd0-47c9-b3b7-06ed574ef808 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.169738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.173100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:52.191244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72793ef-79dc-49ab-b5a6-7c5bcf287157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.192007 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72793ef-79dc-49ab-b5a6-7c5bcf287157 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.192292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72793ef-79dc-49ab-b5a6-7c5bcf287157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.192557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72793ef-79dc-49ab-b5a6-7c5bcf287157 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.193195 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72793ef-79dc-49ab-b5a6-7c5bcf287157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.195220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72793ef-79dc-49ab-b5a6-7c5bcf287157 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.225327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1053/2113] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:52 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:52.228959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72793ef-79dc-49ab-b5a6-7c5bcf287157 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.242206 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72793ef-79dc-49ab-b5a6-7c5bcf287157 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.248845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79aac1-5f04-470e-bc51-f28e0b139c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.249460 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79aac1-5f04-470e-bc51-f28e0b139c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.249735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79aac1-5f04-470e-bc51-f28e0b139c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.250002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79aac1-5f04-470e-bc51-f28e0b139c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.250686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79aac1-5f04-470e-bc51-f28e0b139c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.252393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79aac1-5f04-470e-bc51-f28e0b139c9c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.258746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:52.267250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1054/2114] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:04:52.270812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79aac1-5f04-470e-bc51-f28e0b139c9c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.285256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79aac1-5f04-470e-bc51-f28e0b139c9c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.294109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa464d-c874-4f22-a545-034ac1fe2fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.294747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa464d-c874-4f22-a545-034ac1fe2fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.295375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa464d-c874-4f22-a545-034ac1fe2fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.295649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa464d-c874-4f22-a545-034ac1fe2fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.297814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa464d-c874-4f22-a545-034ac1fe2fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.299655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa464d-c874-4f22-a545-034ac1fe2fd2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.320811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1055/2115] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:04:52.324865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa464d-c874-4f22-a545-034ac1fe2fd2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.340824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa464d-c874-4f22-a545-034ac1fe2fd2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.346576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa2557-ae89-474b-a6ff-e1d287daea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.347357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa2557-ae89-474b-a6ff-e1d287daea20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.347881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa2557-ae89-474b-a6ff-e1d287daea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.348121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa2557-ae89-474b-a6ff-e1d287daea20 admin admin] PATH_INFO: `/v3/projects/1e61bfaac71f473bb5a2f954a30825d1/users/2102afd3427540a788c822c7b823aa88/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.351482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f36b8-c3c1-4bdd-b903-b0d57517f30f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.377679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.378315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.378633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.378914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.380743 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:52.382318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa2557-ae89-474b-a6ff-e1d287daea20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e61bfaac71f473bb5a2f954a30825d1, user_id=2102afd3427540a788c822c7b823aa88, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.387568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa2557-ae89-474b-a6ff-e1d287daea20 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.398306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.400360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.411255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1056/2116] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:52 2022] PUT /identity/v3/projects/1e61bfaac71f473bb5a2f954a30825d1/users/2102afd3427540a788c822c7b823aa88/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:52.422302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32000901-bad6-4ddb-b9b2-1d66b8581d5b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.422682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32000901-bad6-4ddb-b9b2-1d66b8581d5b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.424480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32000901-bad6-4ddb-b9b2-1d66b8581d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.438787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1061/2117] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:52.469748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-32000901-bad6-4ddb-b9b2-1d66b8581d5b None None] MFA Rules not processed for user `2102afd3427540a788c822c7b823aa88`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:52.471110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-32000901-bad6-4ddb-b9b2-1d66b8581d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:52.542843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1057/2118] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:04:52.547213 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.557429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79509020-08dc-4ba8-a40d-ff9df604734f service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.566600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:52.622897 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a33f2-0d3f-4bfd-b0fe-da213f1593d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.623432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a33f2-0d3f-4bfd-b0fe-da213f1593d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.623713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a33f2-0d3f-4bfd-b0fe-da213f1593d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.623991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a33f2-0d3f-4bfd-b0fe-da213f1593d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.624649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a33f2-0d3f-4bfd-b0fe-da213f1593d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.626584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a33f2-0d3f-4bfd-b0fe-da213f1593d3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.654679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1062/2119] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:04:52 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:52.658821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32000901-bad6-4ddb-b9b2-1d66b8581d5b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.670641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32000901-bad6-4ddb-b9b2-1d66b8581d5b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.728071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb522a6-c2f2-4c3a-a57e-44d67bdc8033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.728674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb522a6-c2f2-4c3a-a57e-44d67bdc8033 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.728950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb522a6-c2f2-4c3a-a57e-44d67bdc8033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.729221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb522a6-c2f2-4c3a-a57e-44d67bdc8033 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.730606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb522a6-c2f2-4c3a-a57e-44d67bdc8033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.732725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb522a6-c2f2-4c3a-a57e-44d67bdc8033 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.755710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1058/2120] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:04:52 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:04:52.759408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a33f2-0d3f-4bfd-b0fe-da213f1593d3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.770805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a33f2-0d3f-4bfd-b0fe-da213f1593d3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.776258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ba4db-4280-4bb9-81f7-ac2c06bdaa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.777584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba4db-4280-4bb9-81f7-ac2c06bdaa25 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.777986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba4db-4280-4bb9-81f7-ac2c06bdaa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.778298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba4db-4280-4bb9-81f7-ac2c06bdaa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.778997 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ba4db-4280-4bb9-81f7-ac2c06bdaa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.780606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ba4db-4280-4bb9-81f7-ac2c06bdaa25 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.791739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1063/2121] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:52.802906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb522a6-c2f2-4c3a-a57e-44d67bdc8033 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.815495 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb522a6-c2f2-4c3a-a57e-44d67bdc8033 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.820170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744be31-095d-4037-9966-47c9621c1cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.820820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744be31-095d-4037-9966-47c9621c1cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.821095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744be31-095d-4037-9966-47c9621c1cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.821368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744be31-095d-4037-9966-47c9621c1cfc admin admin] PATH_INFO: `/v3/projects/0fa3172c37e04cd68e9f17d123cc5a5f/users/75f9e9d4e8034e048776f9470fca1e96/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.850345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744be31-095d-4037-9966-47c9621c1cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa3172c37e04cd68e9f17d123cc5a5f, user_id=75f9e9d4e8034e048776f9470fca1e96, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.853828 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744be31-095d-4037-9966-47c9621c1cfc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.872287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1059/2122] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:52 2022] PUT /identity/v3/projects/0fa3172c37e04cd68e9f17d123cc5a5f/users/75f9e9d4e8034e048776f9470fca1e96/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:52.876362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ba4db-4280-4bb9-81f7-ac2c06bdaa25 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:52.901291 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ba4db-4280-4bb9-81f7-ac2c06bdaa25 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:52.970306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bc5cc-e1ab-4b8b-8a7d-63bf8ae699ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:52.971086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc5cc-e1ab-4b8b-8a7d-63bf8ae699ee admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:52.971370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc5cc-e1ab-4b8b-8a7d-63bf8ae699ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:52.971645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bc5cc-e1ab-4b8b-8a7d-63bf8ae699ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:52.972292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bc5cc-e1ab-4b8b-8a7d-63bf8ae699ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:52.973917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bc5cc-e1ab-4b8b-8a7d-63bf8ae699ee admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:52.985343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1064/2123] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:04:52.989952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744be31-095d-4037-9966-47c9621c1cfc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:53.004790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744be31-095d-4037-9966-47c9621c1cfc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:53.011681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:53.012365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:53.012644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:53.012917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] PATH_INFO: `/v3/projects/0fa3172c37e04cd68e9f17d123cc5a5f/users/75f9e9d4e8034e048776f9470fca1e96/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:53.014960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa3172c37e04cd68e9f17d123cc5a5f, user_id=75f9e9d4e8034e048776f9470fca1e96, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:53.017628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:53.032373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1060/2124] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:04:52 2022] PUT /identity/v3/projects/0fa3172c37e04cd68e9f17d123cc5a5f/users/75f9e9d4e8034e048776f9470fca1e96/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:04:53.104170 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1a20d-cc4b-4473-9f0e-e724ec5d4add None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:53.104839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1a20d-cc4b-4473-9f0e-e724ec5d4add None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:53.105166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1a20d-cc4b-4473-9f0e-e724ec5d4add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:53.140614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-89c1a20d-cc4b-4473-9f0e-e724ec5d4add None None] MFA Rules not processed for user `75f9e9d4e8034e048776f9470fca1e96`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:53.141982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-89c1a20d-cc4b-4473-9f0e-e724ec5d4add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:53.223808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1065/2125] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:04:53.240616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:53.241314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:53.259886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:53.315521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88f316-4d8f-4578-ae20-c5fb05d79a56 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:53.319174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f33f6-54f5-4261-a775-741d8705942f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:53.319933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f33f6-54f5-4261-a775-741d8705942f service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:53.320216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f33f6-54f5-4261-a775-741d8705942f service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:53.320488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f33f6-54f5-4261-a775-741d8705942f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:53.385444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f33f6-54f5-4261-a775-741d8705942f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:53.387815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f33f6-54f5-4261-a775-741d8705942f service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:53.397022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1061/2126] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:54.920373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1a20d-cc4b-4473-9f0e-e724ec5d4add None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:54.930255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1a20d-cc4b-4473-9f0e-e724ec5d4add None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:54.935525 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:54.935525 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:54.935525 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:54.935525 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:54.941797 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:55.000404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:55.001918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:55.013415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1066/2127] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:55.608664 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f33f6-54f5-4261-a775-741d8705942f service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:55.618434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f33f6-54f5-4261-a775-741d8705942f service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:55.622673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a28637-c73d-4007-bbb1-e65b838b2c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:55.623273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a28637-c73d-4007-bbb1-e65b838b2c5e service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:55.623551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a28637-c73d-4007-bbb1-e65b838b2c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:55.623823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a28637-c73d-4007-bbb1-e65b838b2c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:55.632926 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a28637-c73d-4007-bbb1-e65b838b2c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:55.634357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a28637-c73d-4007-bbb1-e65b838b2c5e service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:55.644606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1062/2128] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:57.424386 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:57.425831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:57.486755 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944299e-eeb8-4b18-92d5-48fdc632847b service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:57.490575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb96b4-36cb-4ef1-b646-284c0457c257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:57.491177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb96b4-36cb-4ef1-b646-284c0457c257 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:57.491471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb96b4-36cb-4ef1-b646-284c0457c257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:57.491746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb96b4-36cb-4ef1-b646-284c0457c257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:57.493463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b8eb96b4-36cb-4ef1-b646-284c0457c257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:57.555757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb96b4-36cb-4ef1-b646-284c0457c257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:57.557172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb96b4-36cb-4ef1-b646-284c0457c257 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:57.567398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1067/2129] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:04:59.553802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a28637-c73d-4007-bbb1-e65b838b2c5e service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:59.565235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a28637-c73d-4007-bbb1-e65b838b2c5e service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:59.570114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:59.570946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:59.571399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:59.571850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] PATH_INFO: `/v3/users/34efd32e7cec46aab268702ad4afe752` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:59.573164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34efd32e7cec46aab268702ad4afe752)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:59.576192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:59.646423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34efd32e7cec46aab268702ad4afe752'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:59.659944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34efd32e7cec46aab268702ad4afe752'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:59.668300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34efd32e7cec46aab268702ad4afe752'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:59.669099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34efd32e7cec46aab268702ad4afe752'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:59.678276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34efd32e7cec46aab268702ad4afe752'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:04:59.687820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1063/2130] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:04:59 2022] DELETE /identity/v3/users/34efd32e7cec46aab268702ad4afe752 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:04:59.692137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ff7dc-e264-4d2b-9c8f-f59a8948496a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:59.692688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ff7dc-e264-4d2b-9c8f-f59a8948496a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:59.692688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ff7dc-e264-4d2b-9c8f-f59a8948496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:59.713628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-158ff7dc-e264-4d2b-9c8f-f59a8948496a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:04:59.715048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-158ff7dc-e264-4d2b-9c8f-f59a8948496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:59.770309 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:59.784108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1068/2131] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:04:59.796026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:04:59.797493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:04:59.820142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:04:59.862045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19442f6-eac6-4174-a808-578c82ea2b7b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:04:59.866296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571dfed-bbc8-464d-9d7f-b2670cba5059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:04:59.866941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571dfed-bbc8-464d-9d7f-b2670cba5059 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:04:59.867249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571dfed-bbc8-464d-9d7f-b2670cba5059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:04:59.867525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571dfed-bbc8-464d-9d7f-b2670cba5059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:04:59.876901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571dfed-bbc8-464d-9d7f-b2670cba5059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:04:59.878283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571dfed-bbc8-464d-9d7f-b2670cba5059 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:04:59.894216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1064/2132] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:00.586342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ff7dc-e264-4d2b-9c8f-f59a8948496a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:00.588099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-158ff7dc-e264-4d2b-9c8f-f59a8948496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:00.607431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ff7dc-e264-4d2b-9c8f-f59a8948496a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:00.615245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:00.616290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:00.616793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:00.617066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] PATH_INFO: `/v3/projects/e077f33b7e2743318d51fee9ba734b5e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:00.618372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e077f33b7e2743318d51fee9ba734b5e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:00.620457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:00.691502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e077f33b7e2743318d51fee9ba734b5e', 'request_id': 'req-453f3c34-5e90-4255-8fc3-7aa6af4b2947'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.698421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e077f33b7e2743318d51fee9ba734b5e', 'request_id': 'req-453f3c34-5e90-4255-8fc3-7aa6af4b2947'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.705281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e077f33b7e2743318d51fee9ba734b5e', 'request_id': 'req-453f3c34-5e90-4255-8fc3-7aa6af4b2947'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.724813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] The token cache is being invalidate because project e077f33b7e2743318d51fee9ba734b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:00.726044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.726954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.729194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1069/2133] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:00 2022] DELETE /identity/v3/projects/e077f33b7e2743318d51fee9ba734b5e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:00.733397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571dfed-bbc8-464d-9d7f-b2670cba5059 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:00.749171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571dfed-bbc8-464d-9d7f-b2670cba5059 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:00.818273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:00.819072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:00.819535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:00.819851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] PATH_INFO: `/v3/users/2102afd3427540a788c822c7b823aa88` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:00.821051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2102afd3427540a788c822c7b823aa88)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:00.823214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:00.914279 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2102afd3427540a788c822c7b823aa88'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.937948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2102afd3427540a788c822c7b823aa88'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.945829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2102afd3427540a788c822c7b823aa88'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.947422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2102afd3427540a788c822c7b823aa88'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.956403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2102afd3427540a788c822c7b823aa88'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:00.966585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1065/2134] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:00 2022] DELETE /identity/v3/users/2102afd3427540a788c822c7b823aa88 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:01.022026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.023608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:01.046074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f3c34-5e90-4255-8fc3-7aa6af4b2947 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:01.113232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:01.113874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.114154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.114428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] PATH_INFO: `/v3/users/9d51c7335010488d8a2bdc329f975dae` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.115582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d51c7335010488d8a2bdc329f975dae)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:01.117787 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:01.174281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d51c7335010488d8a2bdc329f975dae'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.174964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d51c7335010488d8a2bdc329f975dae'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.182336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d51c7335010488d8a2bdc329f975dae'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.196005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d51c7335010488d8a2bdc329f975dae'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.196710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d51c7335010488d8a2bdc329f975dae'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.205127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:01.212442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1070/2135] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:01 2022] DELETE /identity/v3/users/9d51c7335010488d8a2bdc329f975dae => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:01.280443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.282166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:01.301920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39749-2df1-47c2-8f92-5a8186047157 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:01.348655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:01.367557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:01.368189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.368469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.368737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] PATH_INFO: `/v3/projects/1e61bfaac71f473bb5a2f954a30825d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.369854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e61bfaac71f473bb5a2f954a30825d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:01.372558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:01.407472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.409060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:01.434983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e61bfaac71f473bb5a2f954a30825d1', 'request_id': 'req-36422836-67e7-49e3-aced-a89b0af654ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.438374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dd155-5acd-45f3-ae8a-d2f83b846c5a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:01.443997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e61bfaac71f473bb5a2f954a30825d1', 'request_id': 'req-36422836-67e7-49e3-aced-a89b0af654ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.449702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e61bfaac71f473bb5a2f954a30825d1', 'request_id': 'req-36422836-67e7-49e3-aced-a89b0af654ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.461893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] The token cache is being invalidate because project 1e61bfaac71f473bb5a2f954a30825d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:01.462181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.462862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.464869 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1066/2136] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:01 2022] DELETE /identity/v3/projects/1e61bfaac71f473bb5a2f954a30825d1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:01.469081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.470409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:01.500957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:01.501654 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.502129 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.502433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] PATH_INFO: `/v3/projects/2a0cf8ef665d40da8d0ff8c6024c9f22` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.503638 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0cf8ef665d40da8d0ff8c6024c9f22)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:01.505550 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:01.536596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36422836-67e7-49e3-aced-a89b0af654ba admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:01.541388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:01.542039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.542381 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.542797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] PATH_INFO: `/v3/users/75f9e9d4e8034e048776f9470fca1e96` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.543937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f9e9d4e8034e048776f9470fca1e96)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:01.545886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:01.553760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0cf8ef665d40da8d0ff8c6024c9f22', 'request_id': 'req-d9cbe03e-f7a3-4147-a3b3-2b321256339a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.560848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0cf8ef665d40da8d0ff8c6024c9f22', 'request_id': 'req-d9cbe03e-f7a3-4147-a3b3-2b321256339a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.566384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0cf8ef665d40da8d0ff8c6024c9f22', 'request_id': 'req-d9cbe03e-f7a3-4147-a3b3-2b321256339a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.580717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] The token cache is being invalidate because project 2a0cf8ef665d40da8d0ff8c6024c9f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:01.581046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.581728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d9cbe03e-f7a3-4147-a3b3-2b321256339a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.583376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1071/2137] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:01 2022] DELETE /identity/v3/projects/2a0cf8ef665d40da8d0ff8c6024c9f22 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:01.588137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618d71-1729-449e-bbf7-3d89940586d0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.588418 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618d71-1729-449e-bbf7-3d89940586d0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.588693 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618d71-1729-449e-bbf7-3d89940586d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.596144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f9e9d4e8034e048776f9470fca1e96'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.609850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f9e9d4e8034e048776f9470fca1e96'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.610016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d6618d71-1729-449e-bbf7-3d89940586d0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:01.611163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6618d71-1729-449e-bbf7-3d89940586d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:01.616862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f9e9d4e8034e048776f9470fca1e96'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.617569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f9e9d4e8034e048776f9470fca1e96'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.619471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:01.627464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-59355e10-145c-4e36-b546-3c7e204cd754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f9e9d4e8034e048776f9470fca1e96'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:01.634446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1067/2138] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:01 2022] DELETE /identity/v3/users/75f9e9d4e8034e048776f9470fca1e96 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:01.673991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1072/2139] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:01.683375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd71b-d0b7-4a70-9549-6c00a687d8d1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.683670 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd71b-d0b7-4a70-9549-6c00a687d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.684042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd71b-d0b7-4a70-9549-6c00a687d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.705996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-167bd71b-d0b7-4a70-9549-6c00a687d8d1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:01.707243 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-167bd71b-d0b7-4a70-9549-6c00a687d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:01.771070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1068/2140] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:01.775372 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6618d71-1729-449e-bbf7-3d89940586d0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.788156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6618d71-1729-449e-bbf7-3d89940586d0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:01.794115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:01.794795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.795081 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.795355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.796096 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:01.796413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:01.798002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:01.810588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1073/2141] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:01.815048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd71b-d0b7-4a70-9549-6c00a687d8d1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.825120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd71b-d0b7-4a70-9549-6c00a687d8d1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:01.829856 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:01.830456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.830772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.831045 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.831677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:01.833915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:01.862584 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1069/2142] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:01 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:01.867169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.877817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d8253-a80c-42b4-b77a-a12178aaee60 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:01.897667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:01.927979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.930110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:01.952449 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb87f7e-4f92-49af-bcc2-133045af4276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:01.953156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87f7e-4f92-49af-bcc2-133045af4276 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:01.953480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87f7e-4f92-49af-bcc2-133045af4276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:01.953723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb87f7e-4f92-49af-bcc2-133045af4276 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:01.954407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb87f7e-4f92-49af-bcc2-133045af4276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:01.956501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb87f7e-4f92-49af-bcc2-133045af4276 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:01.983144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1074/2143] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:01 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:01.984211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb87f7e-4f92-49af-bcc2-133045af4276 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:01.994218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb87f7e-4f92-49af-bcc2-133045af4276 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:01.999123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619c27-3a19-4b46-97be-ccded9daad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:01.999717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619c27-3a19-4b46-97be-ccded9daad5e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:02.000008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619c27-3a19-4b46-97be-ccded9daad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:02.000280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619c27-3a19-4b46-97be-ccded9daad5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:02.000927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc619c27-3a19-4b46-97be-ccded9daad5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:02.002544 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc619c27-3a19-4b46-97be-ccded9daad5e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:02.003078 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddf94f-c314-4510-b756-9da713f10e96 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:02.007898 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:02.008534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:02.008821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:02.009099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] PATH_INFO: `/v3/projects/0fa3172c37e04cd68e9f17d123cc5a5f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:02.010259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa3172c37e04cd68e9f17d123cc5a5f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:02.012747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:02.021800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1075/2144] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:02.023479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619c27-3a19-4b46-97be-ccded9daad5e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:02.035403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619c27-3a19-4b46-97be-ccded9daad5e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:02.040277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde3c0-d1e5-40cc-ae81-94ad59d6c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:02.040842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde3c0-d1e5-40cc-ae81-94ad59d6c68f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:02.041114 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde3c0-d1e5-40cc-ae81-94ad59d6c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:02.041382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde3c0-d1e5-40cc-ae81-94ad59d6c68f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:02.042041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fde3c0-d1e5-40cc-ae81-94ad59d6c68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:02.043693 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fde3c0-d1e5-40cc-ae81-94ad59d6c68f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:02.054746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1076/2145] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:02.059139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde3c0-d1e5-40cc-ae81-94ad59d6c68f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:02.062229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa3172c37e04cd68e9f17d123cc5a5f', 'request_id': 'req-4337949d-8e79-4abf-aeb9-8991d08b2931'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:02.069086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa3172c37e04cd68e9f17d123cc5a5f', 'request_id': 'req-4337949d-8e79-4abf-aeb9-8991d08b2931'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:02.069245 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde3c0-d1e5-40cc-ae81-94ad59d6c68f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:02.075732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa3172c37e04cd68e9f17d123cc5a5f', 'request_id': 'req-4337949d-8e79-4abf-aeb9-8991d08b2931'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:02.085378 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:02.090208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] The token cache is being invalidate because project 0fa3172c37e04cd68e9f17d123cc5a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:02.090583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:02.091762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4337949d-8e79-4abf-aeb9-8991d08b2931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:02.093785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1070/2146] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:01 2022] DELETE /identity/v3/projects/0fa3172c37e04cd68e9f17d123cc5a5f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:02.131469 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:02.132089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:02.132370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:02.132642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] PATH_INFO: `/v3/projects/5bd2343b6ca347d08750c4441b21560b/users/fd544c0430ad4920a779283ed138fa31/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:02.150244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd2343b6ca347d08750c4441b21560b, user_id=fd544c0430ad4920a779283ed138fa31, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:02.153737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:02.168739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1077/2147] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:02 2022] PUT /identity/v3/projects/5bd2343b6ca347d08750c4441b21560b/users/fd544c0430ad4920a779283ed138fa31/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:02.173902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed8eb5-ed04-4575-a8da-1619606d0a88 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:02.174182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed8eb5-ed04-4575-a8da-1619606d0a88 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:02.174496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed8eb5-ed04-4575-a8da-1619606d0a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:02.195128 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-eaed8eb5-ed04-4575-a8da-1619606d0a88 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:02.196431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-eaed8eb5-ed04-4575-a8da-1619606d0a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:02.263001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1071/2148] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:02.272917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:02.274711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:02.336597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46130ed1-8f95-458b-abb0-f3396fab8b11 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:02.340445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:02.341050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:02.341328 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:02.341604 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:02.350800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:02.352221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:02.362380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1078/2149] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:02.984244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd590-f5d5-48c6-a882-e3b927682bbd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:02.984765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd590-f5d5-48c6-a882-e3b927682bbd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:02.984765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd590-f5d5-48c6-a882-e3b927682bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:03.019923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-528dd590-f5d5-48c6-a882-e3b927682bbd None None] MFA Rules not processed for user `fd544c0430ad4920a779283ed138fa31`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:03.019923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-528dd590-f5d5-48c6-a882-e3b927682bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:03.094974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1072/2150] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:03.099627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:03.101052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:03.114746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d25598-6476-4338-b81d-3cb6bce8bc8d service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:03.119397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2080d90-0a6d-4e0a-9959-4ef641ebe262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:03.120072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2080d90-0a6d-4e0a-9959-4ef641ebe262 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:03.120458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2080d90-0a6d-4e0a-9959-4ef641ebe262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:03.120802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2080d90-0a6d-4e0a-9959-4ef641ebe262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:03.121504 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2080d90-0a6d-4e0a-9959-4ef641ebe262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:03.123509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2080d90-0a6d-4e0a-9959-4ef641ebe262 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:03.128995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:03.155591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1079/2151] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:03 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:03.157548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd590-f5d5-48c6-a882-e3b927682bbd None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:03.168995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd590-f5d5-48c6-a882-e3b927682bbd None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:03.225222 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087ebb5-4293-4872-b5ac-2580b84dc713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:03.225856 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087ebb5-4293-4872-b5ac-2580b84dc713 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:03.226136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087ebb5-4293-4872-b5ac-2580b84dc713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:03.226407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087ebb5-4293-4872-b5ac-2580b84dc713 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:03.227074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087ebb5-4293-4872-b5ac-2580b84dc713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:03.229013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087ebb5-4293-4872-b5ac-2580b84dc713 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:03.250185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1073/2152] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:03 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:03.254368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2080d90-0a6d-4e0a-9959-4ef641ebe262 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:03.264680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2080d90-0a6d-4e0a-9959-4ef641ebe262 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:03.269197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97268b9-0757-49a6-bc6d-b9005629f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:03.269788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97268b9-0757-49a6-bc6d-b9005629f7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:03.270070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97268b9-0757-49a6-bc6d-b9005629f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:03.270346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97268b9-0757-49a6-bc6d-b9005629f7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:03.271026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97268b9-0757-49a6-bc6d-b9005629f7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:03.272615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97268b9-0757-49a6-bc6d-b9005629f7e0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:03.283489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1080/2153] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:03.287735 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087ebb5-4293-4872-b5ac-2580b84dc713 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:03.298215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087ebb5-4293-4872-b5ac-2580b84dc713 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:03.302811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079843c-87e5-48df-8099-29ac346eb2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:03.303447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079843c-87e5-48df-8099-29ac346eb2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:03.303722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079843c-87e5-48df-8099-29ac346eb2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:03.303991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079843c-87e5-48df-8099-29ac346eb2ae admin admin] PATH_INFO: `/v3/projects/3fba766903e54e02b5a4a09847f48f43/users/ac18866df50d47c6aa9314867eaa778b/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:03.318268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079843c-87e5-48df-8099-29ac346eb2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fba766903e54e02b5a4a09847f48f43, user_id=ac18866df50d47c6aa9314867eaa778b, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:03.320935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079843c-87e5-48df-8099-29ac346eb2ae admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:03.324401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:03.335015 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1074/2154] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:03 2022] PUT /identity/v3/projects/3fba766903e54e02b5a4a09847f48f43/users/ac18866df50d47c6aa9314867eaa778b/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:03.339938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97268b9-0757-49a6-bc6d-b9005629f7e0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:03.349781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97268b9-0757-49a6-bc6d-b9005629f7e0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:03.405885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f70005-3e75-40cc-ba67-89642c1fa0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:03.406483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f70005-3e75-40cc-ba67-89642c1fa0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:03.406790 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f70005-3e75-40cc-ba67-89642c1fa0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:03.407068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f70005-3e75-40cc-ba67-89642c1fa0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:03.407727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f70005-3e75-40cc-ba67-89642c1fa0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:03.409296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f70005-3e75-40cc-ba67-89642c1fa0f7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:03.419637 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1081/2155] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:03.423912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079843c-87e5-48df-8099-29ac346eb2ae admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:03.434800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079843c-87e5-48df-8099-29ac346eb2ae admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:03.439372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:03.440065 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:03.440343 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:03.440617 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] PATH_INFO: `/v3/projects/3fba766903e54e02b5a4a09847f48f43/users/ac18866df50d47c6aa9314867eaa778b/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:03.442503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fba766903e54e02b5a4a09847f48f43, user_id=ac18866df50d47c6aa9314867eaa778b, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:03.445162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:03.455329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1075/2156] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:03 2022] PUT /identity/v3/projects/3fba766903e54e02b5a4a09847f48f43/users/ac18866df50d47c6aa9314867eaa778b/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:04.092280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c04fef-d87f-44cd-aed4-b029c0257d14 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:04.092566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c04fef-d87f-44cd-aed4-b029c0257d14 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:04.092840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c04fef-d87f-44cd-aed4-b029c0257d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:04.123078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-45c04fef-d87f-44cd-aed4-b029c0257d14 None None] MFA Rules not processed for user `ac18866df50d47c6aa9314867eaa778b`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:04.124502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-45c04fef-d87f-44cd-aed4-b029c0257d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:04.194267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1082/2157] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:05.161374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:05.163295 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:05.218348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c04fef-d87f-44cd-aed4-b029c0257d14 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:05.247165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635c64-2b1a-4cb4-8670-1a690175de46 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:05.252245 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:05.252977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:05.253194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:05.253464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:05.255205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:05.266477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:05.268162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:05.278662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1076/2158] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:05.285123 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:05.290040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c04fef-d87f-44cd-aed4-b029c0257d14 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:05.296540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:05.297227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:05.297512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:05.297796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] PATH_INFO: `/v3/users/fd544c0430ad4920a779283ed138fa31` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:05.299011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd544c0430ad4920a779283ed138fa31)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:05.300981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:05.348226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd544c0430ad4920a779283ed138fa31'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.348879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd544c0430ad4920a779283ed138fa31'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.356707 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd544c0430ad4920a779283ed138fa31'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.368737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd544c0430ad4920a779283ed138fa31'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.369395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd544c0430ad4920a779283ed138fa31'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.381728 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1083/2159] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:05 2022] DELETE /identity/v3/users/fd544c0430ad4920a779283ed138fa31 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:05.553579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:05.565016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df80e-611c-496b-b405-d1f8796b7402 service placement] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:05.626095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:05.626770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:05.627052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:05.627330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] PATH_INFO: `/v3/projects/5bd2343b6ca347d08750c4441b21560b` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:05.628457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd2343b6ca347d08750c4441b21560b)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:05.630373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:05.676731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd2343b6ca347d08750c4441b21560b', 'request_id': 'req-d2f638a3-b730-4d97-84e1-77897d87b343'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.683408 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd2343b6ca347d08750c4441b21560b', 'request_id': 'req-d2f638a3-b730-4d97-84e1-77897d87b343'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.688899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd2343b6ca347d08750c4441b21560b', 'request_id': 'req-d2f638a3-b730-4d97-84e1-77897d87b343'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.701071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] The token cache is being invalidate because project 5bd2343b6ca347d08750c4441b21560b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:05.701362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.701986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.703483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1077/2160] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:05 2022] DELETE /identity/v3/projects/5bd2343b6ca347d08750c4441b21560b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:05.707646 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:05.709056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:05.722138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e369dfc-8042-44e2-ab6c-823070dde9b6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:05.779477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:05.780021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:05.780298 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:05.780567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] PATH_INFO: `/v3/users/ac18866df50d47c6aa9314867eaa778b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:05.781682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac18866df50d47c6aa9314867eaa778b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:05.783615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:05.829481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac18866df50d47c6aa9314867eaa778b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.830285 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac18866df50d47c6aa9314867eaa778b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.837567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac18866df50d47c6aa9314867eaa778b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.849917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac18866df50d47c6aa9314867eaa778b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.850624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6e0b364a-94b8-4dfa-906a-353d7f3f8292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac18866df50d47c6aa9314867eaa778b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:05.854120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:05.865909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1084/2161] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:05 2022] DELETE /identity/v3/users/ac18866df50d47c6aa9314867eaa778b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:06.037610 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.039122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:06.047751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:06.053162 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f638a3-b730-4d97-84e1-77897d87b343 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.112639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.113264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.113542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.113809 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] PATH_INFO: `/v3/projects/3fba766903e54e02b5a4a09847f48f43` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.114945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fba766903e54e02b5a4a09847f48f43)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.116830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.162602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fba766903e54e02b5a4a09847f48f43', 'request_id': 'req-b964718c-8d5d-4675-81d7-56cc313a255b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:06.168912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fba766903e54e02b5a4a09847f48f43', 'request_id': 'req-b964718c-8d5d-4675-81d7-56cc313a255b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:06.174389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fba766903e54e02b5a4a09847f48f43', 'request_id': 'req-b964718c-8d5d-4675-81d7-56cc313a255b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:06.186879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] The token cache is being invalidate because project 3fba766903e54e02b5a4a09847f48f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:06.187164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:06.187786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b964718c-8d5d-4675-81d7-56cc313a255b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:06.189242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1078/2162] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:06 2022] DELETE /identity/v3/projects/3fba766903e54e02b5a4a09847f48f43 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:06.194117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401702-9263-4f9b-9594-3f95ffb74633 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.194402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401702-9263-4f9b-9594-3f95ffb74633 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.194698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401702-9263-4f9b-9594-3f95ffb74633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.215840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d6401702-9263-4f9b-9594-3f95ffb74633 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:06.217024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6401702-9263-4f9b-9594-3f95ffb74633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:06.274455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1085/2163] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:06.282704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee444670-82e9-4835-b793-ead223ed3cac None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.282911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee444670-82e9-4835-b793-ead223ed3cac None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.283181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee444670-82e9-4835-b793-ead223ed3cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.303339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ee444670-82e9-4835-b793-ead223ed3cac None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:06.304541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ee444670-82e9-4835-b793-ead223ed3cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:06.312936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1079/2164] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:06.317102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6401702-9263-4f9b-9594-3f95ffb74633 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.327181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6401702-9263-4f9b-9594-3f95ffb74633 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.331711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.332306 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.332594 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.332867 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.333513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:06.333834 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.335429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.347748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1086/2165] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:06.351874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee444670-82e9-4835-b793-ead223ed3cac None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.361605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee444670-82e9-4835-b793-ead223ed3cac None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.366129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b79f16-95f9-49bc-a658-5ce5ad79be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.366749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79f16-95f9-49bc-a658-5ce5ad79be31 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.367026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79f16-95f9-49bc-a658-5ce5ad79be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.367321 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79f16-95f9-49bc-a658-5ce5ad79be31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.367979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b79f16-95f9-49bc-a658-5ce5ad79be31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.370132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b79f16-95f9-49bc-a658-5ce5ad79be31 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.397935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1080/2166] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:06 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:06.402858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.414630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163e302-d35c-420a-b84d-f92b292b9ffd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.471279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496fde9-ba5f-42cc-a842-22b258fe2727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.471884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496fde9-ba5f-42cc-a842-22b258fe2727 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.472164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496fde9-ba5f-42cc-a842-22b258fe2727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.472438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496fde9-ba5f-42cc-a842-22b258fe2727 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.473089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496fde9-ba5f-42cc-a842-22b258fe2727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.475031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496fde9-ba5f-42cc-a842-22b258fe2727 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.495397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1087/2167] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:06 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:06.499899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b79f16-95f9-49bc-a658-5ce5ad79be31 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.510119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b79f16-95f9-49bc-a658-5ce5ad79be31 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.515378 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc65e5-aad3-4473-89dc-253c73c1e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.515967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc65e5-aad3-4473-89dc-253c73c1e282 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.516245 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc65e5-aad3-4473-89dc-253c73c1e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.516519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc65e5-aad3-4473-89dc-253c73c1e282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.517154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc65e5-aad3-4473-89dc-253c73c1e282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.518780 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc65e5-aad3-4473-89dc-253c73c1e282 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.529338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1081/2168] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:06.533326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496fde9-ba5f-42cc-a842-22b258fe2727 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.543484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496fde9-ba5f-42cc-a842-22b258fe2727 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.548273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba9045-15e7-4faa-9a73-504e4cac335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.548871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba9045-15e7-4faa-9a73-504e4cac335d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.549180 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba9045-15e7-4faa-9a73-504e4cac335d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.549456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba9045-15e7-4faa-9a73-504e4cac335d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.550124 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba9045-15e7-4faa-9a73-504e4cac335d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.551737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba9045-15e7-4faa-9a73-504e4cac335d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.562426 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1088/2169] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:06.566288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc65e5-aad3-4473-89dc-253c73c1e282 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.576799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc65e5-aad3-4473-89dc-253c73c1e282 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.581311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1ea18-1c90-41c8-b3c3-1fb3323063a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.581942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1ea18-1c90-41c8-b3c3-1fb3323063a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.582217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1ea18-1c90-41c8-b3c3-1fb3323063a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.582528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1ea18-1c90-41c8-b3c3-1fb3323063a4 admin admin] PATH_INFO: `/v3/projects/aecccd73766147008a1ea6d7df4cf1b3/users/f4a0b559c1e041148fd1bb96266d17d5/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.597040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1ea18-1c90-41c8-b3c3-1fb3323063a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecccd73766147008a1ea6d7df4cf1b3, user_id=f4a0b559c1e041148fd1bb96266d17d5, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.599722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1ea18-1c90-41c8-b3c3-1fb3323063a4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.614844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1082/2170] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:06 2022] PUT /identity/v3/projects/aecccd73766147008a1ea6d7df4cf1b3/users/f4a0b559c1e041148fd1bb96266d17d5/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:06.625832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905641e-4f01-4454-8d00-3dc2135dd479 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.626119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905641e-4f01-4454-8d00-3dc2135dd479 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.626392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905641e-4f01-4454-8d00-3dc2135dd479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.654219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9905641e-4f01-4454-8d00-3dc2135dd479 None None] MFA Rules not processed for user `f4a0b559c1e041148fd1bb96266d17d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:06.655462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9905641e-4f01-4454-8d00-3dc2135dd479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:06.704078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:06.722215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1089/2171] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:06.727003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1ea18-1c90-41c8-b3c3-1fb3323063a4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.758069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:06.790392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1ea18-1c90-41c8-b3c3-1fb3323063a4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.795535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10c08-6c99-4b71-9b12-52e6365ddb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.796131 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10c08-6c99-4b71-9b12-52e6365ddb15 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.796407 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10c08-6c99-4b71-9b12-52e6365ddb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.796681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10c08-6c99-4b71-9b12-52e6365ddb15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.797343 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10c08-6c99-4b71-9b12-52e6365ddb15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.799315 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10c08-6c99-4b71-9b12-52e6365ddb15 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.824880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1083/2172] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:06 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:06.829451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905641e-4f01-4454-8d00-3dc2135dd479 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.840672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905641e-4f01-4454-8d00-3dc2135dd479 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.897632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6dcc1-9812-40f8-867c-994250032bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.898240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6dcc1-9812-40f8-867c-994250032bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.898568 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6dcc1-9812-40f8-867c-994250032bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.898846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6dcc1-9812-40f8-867c-994250032bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.899499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6dcc1-9812-40f8-867c-994250032bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.901906 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6dcc1-9812-40f8-867c-994250032bf1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.926021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1090/2173] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:06 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:06.930122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10c08-6c99-4b71-9b12-52e6365ddb15 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.940642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10c08-6c99-4b71-9b12-52e6365ddb15 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.945280 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acfa4f-76dd-4ecd-a0d6-eaf855c91965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.945869 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acfa4f-76dd-4ecd-a0d6-eaf855c91965 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.946150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acfa4f-76dd-4ecd-a0d6-eaf855c91965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.946423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acfa4f-76dd-4ecd-a0d6-eaf855c91965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:06.947094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acfa4f-76dd-4ecd-a0d6-eaf855c91965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:06.948712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acfa4f-76dd-4ecd-a0d6-eaf855c91965 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:06.964229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1084/2174] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:06.968545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6dcc1-9812-40f8-867c-994250032bf1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:06.978877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6dcc1-9812-40f8-867c-994250032bf1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:06.984663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86609fb-b992-409b-bf9b-c002a13f9d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:06.985313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86609fb-b992-409b-bf9b-c002a13f9d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:06.985596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86609fb-b992-409b-bf9b-c002a13f9d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:06.985868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86609fb-b992-409b-bf9b-c002a13f9d6b admin admin] PATH_INFO: `/v3/projects/06e44b279fce4badab73cfe8761c7dc5/users/7b7b0509b62e4bf3a97366e4e27ff9e4/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:07.001503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86609fb-b992-409b-bf9b-c002a13f9d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e44b279fce4badab73cfe8761c7dc5, user_id=7b7b0509b62e4bf3a97366e4e27ff9e4, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:07.004332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86609fb-b992-409b-bf9b-c002a13f9d6b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:07.017726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1091/2175] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:06 2022] PUT /identity/v3/projects/06e44b279fce4badab73cfe8761c7dc5/users/7b7b0509b62e4bf3a97366e4e27ff9e4/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:07.021742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acfa4f-76dd-4ecd-a0d6-eaf855c91965 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:07.032549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acfa4f-76dd-4ecd-a0d6-eaf855c91965 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:07.091081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3472-a26f-4ebf-8b5c-c7987a7930e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:07.091691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3472-a26f-4ebf-8b5c-c7987a7930e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:07.091974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3472-a26f-4ebf-8b5c-c7987a7930e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:07.092249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3472-a26f-4ebf-8b5c-c7987a7930e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:07.092888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f3472-a26f-4ebf-8b5c-c7987a7930e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:07.094492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f3472-a26f-4ebf-8b5c-c7987a7930e8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:07.108147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1085/2176] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:07.109562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86609fb-b992-409b-bf9b-c002a13f9d6b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:07.120277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86609fb-b992-409b-bf9b-c002a13f9d6b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:07.125154 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:07.125793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:07.126073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:07.126351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] PATH_INFO: `/v3/projects/06e44b279fce4badab73cfe8761c7dc5/users/7b7b0509b62e4bf3a97366e4e27ff9e4/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:07.128397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e44b279fce4badab73cfe8761c7dc5, user_id=7b7b0509b62e4bf3a97366e4e27ff9e4, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:07.131117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:07.142843 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1092/2177] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:07 2022] PUT /identity/v3/projects/06e44b279fce4badab73cfe8761c7dc5/users/7b7b0509b62e4bf3a97366e4e27ff9e4/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:07.154675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f166a6-9c82-4c64-9e49-54cfb3b884a4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:07.154974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f166a6-9c82-4c64-9e49-54cfb3b884a4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:07.155264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f166a6-9c82-4c64-9e49-54cfb3b884a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:07.187720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-51f166a6-9c82-4c64-9e49-54cfb3b884a4 None None] MFA Rules not processed for user `7b7b0509b62e4bf3a97366e4e27ff9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:07.189008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-51f166a6-9c82-4c64-9e49-54cfb3b884a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:07.271935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1086/2178] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:07.284078 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:07.285781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:07.344645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453586-6d18-4179-a392-82c2169b629c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:07.348330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c7a25-fcb4-41c3-93c3-5f5c3ce01e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:07.348924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c7a25-fcb4-41c3-93c3-5f5c3ce01e4a service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:07.349199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c7a25-fcb4-41c3-93c3-5f5c3ce01e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:07.349467 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c7a25-fcb4-41c3-93c3-5f5c3ce01e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:07.358574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c7a25-fcb4-41c3-93c3-5f5c3ce01e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:07.359995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c7a25-fcb4-41c3-93c3-5f5c3ce01e4a service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:07.369516 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1093/2179] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:07.444897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f166a6-9c82-4c64-9e49-54cfb3b884a4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:07.455051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f166a6-9c82-4c64-9e49-54cfb3b884a4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:07.458756 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a953436-1eb0-4136-b5e3-9ad2efb52bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:07.459483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a953436-1eb0-4136-b5e3-9ad2efb52bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:07.459810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a953436-1eb0-4136-b5e3-9ad2efb52bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:07.460096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a953436-1eb0-4136-b5e3-9ad2efb52bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:07.481562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:07.519513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a953436-1eb0-4136-b5e3-9ad2efb52bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:07.520963 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a953436-1eb0-4136-b5e3-9ad2efb52bc4 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:07.529899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1087/2180] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:14.312463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c7a25-fcb4-41c3-93c3-5f5c3ce01e4a service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:14.359648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:14.376630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c7a25-fcb4-41c3-93c3-5f5c3ce01e4a service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:14.381287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:14.381914 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:14.382194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:14.382466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] PATH_INFO: `/v3/users/f4a0b559c1e041148fd1bb96266d17d5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:14.383619 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a0b559c1e041148fd1bb96266d17d5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:14.385543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:14.430887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a0b559c1e041148fd1bb96266d17d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:14.431477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a0b559c1e041148fd1bb96266d17d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:14.438945 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a0b559c1e041148fd1bb96266d17d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:14.451417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a0b559c1e041148fd1bb96266d17d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:14.452065 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a0b559c1e041148fd1bb96266d17d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:14.464343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1094/2181] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:14 2022] DELETE /identity/v3/users/f4a0b559c1e041148fd1bb96266d17d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:14.468895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedea79-15dd-4add-8714-11b4fa8818ec None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:14.469391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedea79-15dd-4add-8714-11b4fa8818ec None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:14.469521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedea79-15dd-4add-8714-11b4fa8818ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:14.488501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-faedea79-15dd-4add-8714-11b4fa8818ec None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:14.489677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-faedea79-15dd-4add-8714-11b4fa8818ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:14.549296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1088/2182] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:14.559106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:14.560589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:14.621083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c67c6-bd39-4964-93bd-17fd25cd0d66 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:14.624947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce3c40-a508-48dc-beb3-a5a55e44362b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:14.625547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce3c40-a508-48dc-beb3-a5a55e44362b service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:14.625822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce3c40-a508-48dc-beb3-a5a55e44362b service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:14.626091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce3c40-a508-48dc-beb3-a5a55e44362b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:14.635028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce3c40-a508-48dc-beb3-a5a55e44362b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:14.636531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce3c40-a508-48dc-beb3-a5a55e44362b service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:14.646734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1095/2183] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:14.914661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedea79-15dd-4add-8714-11b4fa8818ec None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:14.916242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-faedea79-15dd-4add-8714-11b4fa8818ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:14.929628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedea79-15dd-4add-8714-11b4fa8818ec None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:14.936470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:14.937099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:14.937380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:14.937649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] PATH_INFO: `/v3/projects/aecccd73766147008a1ea6d7df4cf1b3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:14.938796 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecccd73766147008a1ea6d7df4cf1b3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:14.940704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:14.988026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecccd73766147008a1ea6d7df4cf1b3', 'request_id': 'req-39135d84-fd6f-410c-9809-c76f544f1a07'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:14.994244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecccd73766147008a1ea6d7df4cf1b3', 'request_id': 'req-39135d84-fd6f-410c-9809-c76f544f1a07'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.001200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecccd73766147008a1ea6d7df4cf1b3', 'request_id': 'req-39135d84-fd6f-410c-9809-c76f544f1a07'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.016478 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] The token cache is being invalidate because project aecccd73766147008a1ea6d7df4cf1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:15.016792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.017662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.019338 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1089/2184] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:14 2022] DELETE /identity/v3/projects/aecccd73766147008a1ea6d7df4cf1b3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:15.023384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce3c40-a508-48dc-beb3-a5a55e44362b service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:15.033520 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce3c40-a508-48dc-beb3-a5a55e44362b service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:15.092470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:15.093101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.093376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.093736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] PATH_INFO: `/v3/users/7b7b0509b62e4bf3a97366e4e27ff9e4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.094784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7b0509b62e4bf3a97366e4e27ff9e4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:15.096912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:15.109290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:15.147885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7b0509b62e4bf3a97366e4e27ff9e4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.148534 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7b0509b62e4bf3a97366e4e27ff9e4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.156327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7b0509b62e4bf3a97366e4e27ff9e4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.169384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7b0509b62e4bf3a97366e4e27ff9e4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.170114 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09cb812d-a1d6-415b-8e6b-29b1c5acdfda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7b0509b62e4bf3a97366e4e27ff9e4'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.182810 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1096/2185] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:15 2022] DELETE /identity/v3/users/7b7b0509b62e4bf3a97366e4e27ff9e4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:15.472741 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:15.474278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:15.487751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39135d84-fd6f-410c-9809-c76f544f1a07 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:15.533733 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:15.548872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:15.549497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.549772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.550040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] PATH_INFO: `/v3/projects/06e44b279fce4badab73cfe8761c7dc5` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.551182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e44b279fce4badab73cfe8761c7dc5)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:15.553133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:15.597934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e44b279fce4badab73cfe8761c7dc5', 'request_id': 'req-d084904c-7193-452e-b240-133df5d71da8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.604058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e44b279fce4badab73cfe8761c7dc5', 'request_id': 'req-d084904c-7193-452e-b240-133df5d71da8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.609928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e44b279fce4badab73cfe8761c7dc5', 'request_id': 'req-d084904c-7193-452e-b240-133df5d71da8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.627044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] The token cache is being invalidate because project 06e44b279fce4badab73cfe8761c7dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:15.627334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.627945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d084904c-7193-452e-b240-133df5d71da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:15.629420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1090/2186] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:15 2022] DELETE /identity/v3/projects/06e44b279fce4badab73cfe8761c7dc5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:15.634283 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a41721-87c3-40ab-9c98-a4fa31f09c37 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.634768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a41721-87c3-40ab-9c98-a4fa31f09c37 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.634887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a41721-87c3-40ab-9c98-a4fa31f09c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.656033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-15a41721-87c3-40ab-9c98-a4fa31f09c37 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:15.657236 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-15a41721-87c3-40ab-9c98-a4fa31f09c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:15.717779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1097/2187] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:15.725523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba705-291b-40c3-9023-6da6b1d56bd0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.725811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba705-291b-40c3-9023-6da6b1d56bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.726088 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba705-291b-40c3-9023-6da6b1d56bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.746848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9d9ba705-291b-40c3-9023-6da6b1d56bd0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:15.748456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9d9ba705-291b-40c3-9023-6da6b1d56bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:15.756309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1091/2188] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:15.760428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a41721-87c3-40ab-9c98-a4fa31f09c37 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:15.770784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a41721-87c3-40ab-9c98-a4fa31f09c37 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:15.775295 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:15.775884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.776159 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.776427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.777070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:15.777369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:15.779021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:15.790352 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1098/2189] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:15.794720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ba705-291b-40c3-9023-6da6b1d56bd0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:15.804179 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ba705-291b-40c3-9023-6da6b1d56bd0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:15.809270 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95b03b-bfeb-42c2-86b3-75420f529e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:15.809950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b03b-bfeb-42c2-86b3-75420f529e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.810233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b03b-bfeb-42c2-86b3-75420f529e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.810504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95b03b-bfeb-42c2-86b3-75420f529e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.811173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95b03b-bfeb-42c2-86b3-75420f529e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:15.813080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95b03b-bfeb-42c2-86b3-75420f529e59 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:15.840053 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1092/2190] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:15 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:15.844340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:15.854073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512739ba-113a-428d-bab6-9d9e907126ce admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:15.914888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442c275-c0a4-4d13-902e-3d2d4b50c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:15.915493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c275-c0a4-4d13-902e-3d2d4b50c1dd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.915768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c275-c0a4-4d13-902e-3d2d4b50c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.916040 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c275-c0a4-4d13-902e-3d2d4b50c1dd admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.916675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442c275-c0a4-4d13-902e-3d2d4b50c1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:15.918653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442c275-c0a4-4d13-902e-3d2d4b50c1dd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:15.940216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1099/2191] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:15 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:15.944505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95b03b-bfeb-42c2-86b3-75420f529e59 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:15.955501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95b03b-bfeb-42c2-86b3-75420f529e59 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:15.960038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aa99e-7d24-49aa-a26b-e9435c6e9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:15.960627 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa99e-7d24-49aa-a26b-e9435c6e9be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.960920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa99e-7d24-49aa-a26b-e9435c6e9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.961177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa99e-7d24-49aa-a26b-e9435c6e9be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.961815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aa99e-7d24-49aa-a26b-e9435c6e9be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:15.963440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aa99e-7d24-49aa-a26b-e9435c6e9be2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:15.973241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1093/2192] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:15.977074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442c275-c0a4-4d13-902e-3d2d4b50c1dd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:15.983928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:15.988142 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442c275-c0a4-4d13-902e-3d2d4b50c1dd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:15.993596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6085453-b8a3-412d-8456-4f1f1f4f9073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:15.994461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085453-b8a3-412d-8456-4f1f1f4f9073 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:15.994928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085453-b8a3-412d-8456-4f1f1f4f9073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:15.995257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085453-b8a3-412d-8456-4f1f1f4f9073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:15.996047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6085453-b8a3-412d-8456-4f1f1f4f9073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:15.998583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6085453-b8a3-412d-8456-4f1f1f4f9073 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.009188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1100/2193] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:16.014462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aa99e-7d24-49aa-a26b-e9435c6e9be2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.024578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aa99e-7d24-49aa-a26b-e9435c6e9be2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.030535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.031193 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.031471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.031742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] PATH_INFO: `/v3/projects/073eb08312694bb4b5153d59861af7e8/users/dedaaad06b7743c48ba27d37e3c947be/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.049293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073eb08312694bb4b5153d59861af7e8, user_id=dedaaad06b7743c48ba27d37e3c947be, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.052099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.065244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1094/2194] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:16 2022] PUT /identity/v3/projects/073eb08312694bb4b5153d59861af7e8/users/dedaaad06b7743c48ba27d37e3c947be/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:16.075904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c85e-0fcb-4fd0-a74c-82c6e6e1eca4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.076197 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c85e-0fcb-4fd0-a74c-82c6e6e1eca4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.076479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c85e-0fcb-4fd0-a74c-82c6e6e1eca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.080974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.082606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:16.104483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ae38c85e-0fcb-4fd0-a74c-82c6e6e1eca4 None None] MFA Rules not processed for user `dedaaad06b7743c48ba27d37e3c947be`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:16.106313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ae38c85e-0fcb-4fd0-a74c-82c6e6e1eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:16.141092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367a318-a73d-43f4-85cc-72fe4f025cb8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.145303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.145905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.146182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.146456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.148227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:16.177383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:16.179528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1101/2195] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:16.185308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38c85e-0fcb-4fd0-a74c-82c6e6e1eca4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.212987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.214480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.223812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1095/2196] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:16.249706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38c85e-0fcb-4fd0-a74c-82c6e6e1eca4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.254302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae162-4137-4537-8ccd-637165019cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.254945 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae162-4137-4537-8ccd-637165019cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.255224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae162-4137-4537-8ccd-637165019cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.255494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae162-4137-4537-8ccd-637165019cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.256128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ae162-4137-4537-8ccd-637165019cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.258023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ae162-4137-4537-8ccd-637165019cd7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.299161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1102/2197] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:16 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:16.300373 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.311375 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8495-efc1-42f0-bc56-8dcf6b83cc8b service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.375602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c382-ab5f-4dd5-b527-47a0309a721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.376216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c382-ab5f-4dd5-b527-47a0309a721f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.376496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c382-ab5f-4dd5-b527-47a0309a721f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.376769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c382-ab5f-4dd5-b527-47a0309a721f admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.377417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41c382-ab5f-4dd5-b527-47a0309a721f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.379388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41c382-ab5f-4dd5-b527-47a0309a721f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.405777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1096/2198] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:16 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:16.407150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae162-4137-4537-8ccd-637165019cd7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.419975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae162-4137-4537-8ccd-637165019cd7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.424829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5aea-0da2-4184-8c62-07085bd450fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.425438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5aea-0da2-4184-8c62-07085bd450fd admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.425729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5aea-0da2-4184-8c62-07085bd450fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.426070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5aea-0da2-4184-8c62-07085bd450fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.426986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5aea-0da2-4184-8c62-07085bd450fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.428652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5aea-0da2-4184-8c62-07085bd450fd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.440761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1103/2199] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:16.444954 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c382-ab5f-4dd5-b527-47a0309a721f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.455892 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c382-ab5f-4dd5-b527-47a0309a721f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.460457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88e5b2-ee95-43ff-8ac2-4aa508320193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.461092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88e5b2-ee95-43ff-8ac2-4aa508320193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.461370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88e5b2-ee95-43ff-8ac2-4aa508320193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.461641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88e5b2-ee95-43ff-8ac2-4aa508320193 admin admin] PATH_INFO: `/v3/projects/08e5e3d9246b4e11b04d57bafb6c2741/users/b654f82e8ce04422b363d4705ef67cf4/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.476785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88e5b2-ee95-43ff-8ac2-4aa508320193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e5e3d9246b4e11b04d57bafb6c2741, user_id=b654f82e8ce04422b363d4705ef67cf4, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.479496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88e5b2-ee95-43ff-8ac2-4aa508320193 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.492507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1097/2200] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:16 2022] PUT /identity/v3/projects/08e5e3d9246b4e11b04d57bafb6c2741/users/b654f82e8ce04422b363d4705ef67cf4/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:16.497087 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5aea-0da2-4184-8c62-07085bd450fd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.507070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5aea-0da2-4184-8c62-07085bd450fd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.559466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:16.566350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2d60e-6736-4284-bc28-dfd713ef3fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.566986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2d60e-6736-4284-bc28-dfd713ef3fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.567269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2d60e-6736-4284-bc28-dfd713ef3fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.567546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2d60e-6736-4284-bc28-dfd713ef3fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.568185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2d60e-6736-4284-bc28-dfd713ef3fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.569776 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2d60e-6736-4284-bc28-dfd713ef3fe0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.580446 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1104/2201] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:16.584651 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88e5b2-ee95-43ff-8ac2-4aa508320193 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.594767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88e5b2-ee95-43ff-8ac2-4aa508320193 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.599306 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.599938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.600215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.600506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] PATH_INFO: `/v3/projects/08e5e3d9246b4e11b04d57bafb6c2741/users/b654f82e8ce04422b363d4705ef67cf4/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.602585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e5e3d9246b4e11b04d57bafb6c2741, user_id=b654f82e8ce04422b363d4705ef67cf4, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.605228 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.616265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1098/2202] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:16 2022] PUT /identity/v3/projects/08e5e3d9246b4e11b04d57bafb6c2741/users/b654f82e8ce04422b363d4705ef67cf4/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:16.628307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deced5f-9885-4943-bb5d-58cb361e9ef7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.628600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deced5f-9885-4943-bb5d-58cb361e9ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.628879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deced5f-9885-4943-bb5d-58cb361e9ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.658331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1deced5f-9885-4943-bb5d-58cb361e9ef7 None None] MFA Rules not processed for user `b654f82e8ce04422b363d4705ef67cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:16.659562 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1deced5f-9885-4943-bb5d-58cb361e9ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:16.726484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1105/2203] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:16.738344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.740132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:16.798405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7ce2-4c72-4001-a8cd-8d5bbce52dc5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.802001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12502b5a-672a-4aa3-9c08-0a7fe802ce7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.802630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12502b5a-672a-4aa3-9c08-0a7fe802ce7b service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.802905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12502b5a-672a-4aa3-9c08-0a7fe802ce7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.803170 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12502b5a-672a-4aa3-9c08-0a7fe802ce7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.813558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12502b5a-672a-4aa3-9c08-0a7fe802ce7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.814964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12502b5a-672a-4aa3-9c08-0a7fe802ce7b service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.824278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1099/2204] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:16.900969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deced5f-9885-4943-bb5d-58cb361e9ef7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:16.911005 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deced5f-9885-4943-bb5d-58cb361e9ef7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:16.914623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df675c0-41aa-4f5a-9208-39cacc2a1a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:16.915221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df675c0-41aa-4f5a-9208-39cacc2a1a7f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:16.915498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df675c0-41aa-4f5a-9208-39cacc2a1a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:16.915770 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df675c0-41aa-4f5a-9208-39cacc2a1a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:16.971814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df675c0-41aa-4f5a-9208-39cacc2a1a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:16.973235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df675c0-41aa-4f5a-9208-39cacc2a1a7f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:16.982452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1106/2205] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:24.027445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12502b5a-672a-4aa3-9c08-0a7fe802ce7b service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:24.054117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:24.093119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12502b5a-672a-4aa3-9c08-0a7fe802ce7b service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:24.097659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:24.098283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:24.098580 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:24.098854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] PATH_INFO: `/v3/users/dedaaad06b7743c48ba27d37e3c947be` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:24.099970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedaaad06b7743c48ba27d37e3c947be)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:24.101889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:24.151981 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedaaad06b7743c48ba27d37e3c947be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.165831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedaaad06b7743c48ba27d37e3c947be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.174027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedaaad06b7743c48ba27d37e3c947be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.174868 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedaaad06b7743c48ba27d37e3c947be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.188399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedaaad06b7743c48ba27d37e3c947be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.196364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1100/2206] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:24 2022] DELETE /identity/v3/users/dedaaad06b7743c48ba27d37e3c947be => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:24.201748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f7a1-6a94-46c3-8bcf-e0258fba150f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:24.202202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f7a1-6a94-46c3-8bcf-e0258fba150f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:24.202610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f7a1-6a94-46c3-8bcf-e0258fba150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:24.223712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e803f7a1-6a94-46c3-8bcf-e0258fba150f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:24.224928 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e803f7a1-6a94-46c3-8bcf-e0258fba150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:24.289023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1107/2207] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:24.300292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:24.301899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:24.362370 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efbd12-3de0-4161-9b05-6b97b49094a3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:24.366004 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad6a8-308e-447e-8eb9-fbe5af1e0093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:24.366638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad6a8-308e-447e-8eb9-fbe5af1e0093 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:24.366922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad6a8-308e-447e-8eb9-fbe5af1e0093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:24.367194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad6a8-308e-447e-8eb9-fbe5af1e0093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:24.377461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad6a8-308e-447e-8eb9-fbe5af1e0093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:24.378959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad6a8-308e-447e-8eb9-fbe5af1e0093 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:24.389662 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1101/2208] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:24.758859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f7a1-6a94-46c3-8bcf-e0258fba150f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:24.761004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e803f7a1-6a94-46c3-8bcf-e0258fba150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:24.774411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f7a1-6a94-46c3-8bcf-e0258fba150f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:24.791019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:24.791780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:24.792148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:24.792445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] PATH_INFO: `/v3/projects/073eb08312694bb4b5153d59861af7e8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:24.794468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=073eb08312694bb4b5153d59861af7e8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:24.797241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:24.812088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:24.849729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073eb08312694bb4b5153d59861af7e8', 'request_id': 'req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.856009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073eb08312694bb4b5153d59861af7e8', 'request_id': 'req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.862727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073eb08312694bb4b5153d59861af7e8', 'request_id': 'req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.874724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] The token cache is being invalidate because project 073eb08312694bb4b5153d59861af7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:24.875009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.875618 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:24.877093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1108/2209] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:24 2022] DELETE /identity/v3/projects/073eb08312694bb4b5153d59861af7e8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:24.881048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad6a8-308e-447e-8eb9-fbe5af1e0093 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:24.891192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad6a8-308e-447e-8eb9-fbe5af1e0093 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:24.934779 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:24.952120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:24.952751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:24.953037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:24.953311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] PATH_INFO: `/v3/users/b654f82e8ce04422b363d4705ef67cf4` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:24.954430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b654f82e8ce04422b363d4705ef67cf4)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:24.956389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:25.005907 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b654f82e8ce04422b363d4705ef67cf4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.018948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b654f82e8ce04422b363d4705ef67cf4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.026909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b654f82e8ce04422b363d4705ef67cf4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.027608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b654f82e8ce04422b363d4705ef67cf4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.035830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-28bf824c-59e5-4d49-8c3b-f0a71f6843a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b654f82e8ce04422b363d4705ef67cf4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.042356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1102/2210] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:24 2022] DELETE /identity/v3/users/b654f82e8ce04422b363d4705ef67cf4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:25.336660 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:25.338116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:25.352710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d9c3d-70fd-4384-b859-79fbd7e7a1dc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:25.413064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:25.413744 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.414029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.414308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] PATH_INFO: `/v3/projects/08e5e3d9246b4e11b04d57bafb6c2741` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.415484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e5e3d9246b4e11b04d57bafb6c2741)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:25.417429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:25.473524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e5e3d9246b4e11b04d57bafb6c2741', 'request_id': 'req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.479826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e5e3d9246b4e11b04d57bafb6c2741', 'request_id': 'req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.485420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e5e3d9246b4e11b04d57bafb6c2741', 'request_id': 'req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.498404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] The token cache is being invalidate because project 08e5e3d9246b4e11b04d57bafb6c2741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:25.498727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.499357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a58ec6e4-bc7e-4cc9-a632-c7adbf8d0e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:25.500840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1109/2211] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:25 2022] DELETE /identity/v3/projects/08e5e3d9246b4e11b04d57bafb6c2741 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:25.505911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc33a-d9e9-4f87-be5e-49031c08c4a4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.506200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc33a-d9e9-4f87-be5e-49031c08c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.506476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc33a-d9e9-4f87-be5e-49031c08c4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.526016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-966cc33a-d9e9-4f87-be5e-49031c08c4a4 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:25.527226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-966cc33a-d9e9-4f87-be5e-49031c08c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:25.585900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1103/2212] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:25.593841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e566e-0ee4-4928-b115-d775b09f8bc7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.594121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e566e-0ee4-4928-b115-d775b09f8bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.594394 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e566e-0ee4-4928-b115-d775b09f8bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.614887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b96e566e-0ee4-4928-b115-d775b09f8bc7 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:25.616088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b96e566e-0ee4-4928-b115-d775b09f8bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:25.625202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1110/2213] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:25.629641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cc33a-d9e9-4f87-be5e-49031c08c4a4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:25.640300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cc33a-d9e9-4f87-be5e-49031c08c4a4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:25.644801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:25.645385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.645660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.645956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.646630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:25.646930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:25.648574 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:25.660962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1104/2214] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:25.665340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e566e-0ee4-4928-b115-d775b09f8bc7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:25.674716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e566e-0ee4-4928-b115-d775b09f8bc7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:25.679302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d688c-e786-44e2-b594-be7202b5b44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:25.679887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d688c-e786-44e2-b594-be7202b5b44a admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.680163 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d688c-e786-44e2-b594-be7202b5b44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.680432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d688c-e786-44e2-b594-be7202b5b44a admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.681088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d688c-e786-44e2-b594-be7202b5b44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:25.683026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d688c-e786-44e2-b594-be7202b5b44a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:25.711277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1111/2215] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:25 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:25.715461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:25.725282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561063f-49d5-4fd3-99db-bc21a9dcaeca admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:25.772050 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:25.783383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ce72d-09ef-46d3-a320-59bbba1a83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:25.783976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ce72d-09ef-46d3-a320-59bbba1a83a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.784250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ce72d-09ef-46d3-a320-59bbba1a83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.784515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ce72d-09ef-46d3-a320-59bbba1a83a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.785142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ce72d-09ef-46d3-a320-59bbba1a83a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:25.787108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ce72d-09ef-46d3-a320-59bbba1a83a0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:25.808037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1105/2216] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:25 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:25.812736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d688c-e786-44e2-b594-be7202b5b44a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:25.818113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:25.824456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d688c-e786-44e2-b594-be7202b5b44a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:25.830650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156f8a-36de-4a5f-9ade-513b907f1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:25.831267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156f8a-36de-4a5f-9ade-513b907f1d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.831546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156f8a-36de-4a5f-9ade-513b907f1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.831823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156f8a-36de-4a5f-9ade-513b907f1d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.832476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f156f8a-36de-4a5f-9ade-513b907f1d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:25.834069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f156f8a-36de-4a5f-9ade-513b907f1d21 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:25.844462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1112/2217] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:25.848379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ce72d-09ef-46d3-a320-59bbba1a83a0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:25.859094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ce72d-09ef-46d3-a320-59bbba1a83a0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:25.864168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c015023-b92e-472d-aa09-21eb085808cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:25.864842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c015023-b92e-472d-aa09-21eb085808cd admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.865191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c015023-b92e-472d-aa09-21eb085808cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.865474 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c015023-b92e-472d-aa09-21eb085808cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.866120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c015023-b92e-472d-aa09-21eb085808cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:25.867749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c015023-b92e-472d-aa09-21eb085808cd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:25.879853 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1106/2218] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:25.884370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156f8a-36de-4a5f-9ade-513b907f1d21 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:25.896645 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156f8a-36de-4a5f-9ade-513b907f1d21 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:25.901781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904837f2-a740-42a0-966e-6d93998db492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:25.902532 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904837f2-a740-42a0-966e-6d93998db492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.902888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904837f2-a740-42a0-966e-6d93998db492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.903358 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904837f2-a740-42a0-966e-6d93998db492 admin admin] PATH_INFO: `/v3/projects/728912647830461f8ec85aa903e950a9/users/e15396c975c1473eb20f38f59ba6cd35/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.922329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904837f2-a740-42a0-966e-6d93998db492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=728912647830461f8ec85aa903e950a9, user_id=e15396c975c1473eb20f38f59ba6cd35, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:25.925134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904837f2-a740-42a0-966e-6d93998db492 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:25.940551 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1113/2219] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:25 2022] PUT /identity/v3/projects/728912647830461f8ec85aa903e950a9/users/e15396c975c1473eb20f38f59ba6cd35/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:25.952759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8c6b-0e8c-4409-84b4-9b154d55fd9a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:25.953103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8c6b-0e8c-4409-84b4-9b154d55fd9a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:25.953397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8c6b-0e8c-4409-84b4-9b154d55fd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:25.981930 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2e4e8c6b-0e8c-4409-84b4-9b154d55fd9a None None] MFA Rules not processed for user `e15396c975c1473eb20f38f59ba6cd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:25.983089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2e4e8c6b-0e8c-4409-84b4-9b154d55fd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:26.047934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1107/2220] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:26.052528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904837f2-a740-42a0-966e-6d93998db492 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.117769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904837f2-a740-42a0-966e-6d93998db492 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.123221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568f2c-d689-48da-af78-105e3d592d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.123857 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568f2c-d689-48da-af78-105e3d592d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.124134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568f2c-d689-48da-af78-105e3d592d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.124407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568f2c-d689-48da-af78-105e3d592d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.125041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568f2c-d689-48da-af78-105e3d592d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.126965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568f2c-d689-48da-af78-105e3d592d0e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.153603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1114/2221] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:26 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:26.157703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8c6b-0e8c-4409-84b4-9b154d55fd9a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.168206 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8c6b-0e8c-4409-84b4-9b154d55fd9a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.226576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d1300-4cac-48db-8ae3-3fc9aaa89353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.227189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1300-4cac-48db-8ae3-3fc9aaa89353 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.227464 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1300-4cac-48db-8ae3-3fc9aaa89353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.227731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1300-4cac-48db-8ae3-3fc9aaa89353 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.228363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d1300-4cac-48db-8ae3-3fc9aaa89353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.230255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d1300-4cac-48db-8ae3-3fc9aaa89353 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.252581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1108/2222] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:26 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:26.256629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568f2c-d689-48da-af78-105e3d592d0e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.267118 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568f2c-d689-48da-af78-105e3d592d0e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.271942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457f5a1-0049-4973-9cfb-e3329cf9dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.272537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f5a1-0049-4973-9cfb-e3329cf9dbdf admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.272814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f5a1-0049-4973-9cfb-e3329cf9dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.273084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f5a1-0049-4973-9cfb-e3329cf9dbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.273724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457f5a1-0049-4973-9cfb-e3329cf9dbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.275383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457f5a1-0049-4973-9cfb-e3329cf9dbdf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.287740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1115/2223] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:26.291623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d1300-4cac-48db-8ae3-3fc9aaa89353 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.302137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d1300-4cac-48db-8ae3-3fc9aaa89353 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.306690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b5ccc-faa6-422e-98e9-fca8e9bea843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.307273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5ccc-faa6-422e-98e9-fca8e9bea843 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.307549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5ccc-faa6-422e-98e9-fca8e9bea843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.307816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5ccc-faa6-422e-98e9-fca8e9bea843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.308448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b5ccc-faa6-422e-98e9-fca8e9bea843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.310040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b5ccc-faa6-422e-98e9-fca8e9bea843 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.319698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1109/2224] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:26.323753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457f5a1-0049-4973-9cfb-e3329cf9dbdf admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.333746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457f5a1-0049-4973-9cfb-e3329cf9dbdf admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.338680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f036-1f7c-4b65-b974-8c719bfd6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.339478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f036-1f7c-4b65-b974-8c719bfd6a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.339767 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f036-1f7c-4b65-b974-8c719bfd6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.340044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f036-1f7c-4b65-b974-8c719bfd6a50 admin admin] PATH_INFO: `/v3/projects/1fb387f7cf0e4d96aa607a60612fb268/users/a0ff1f4c82ad4156927e4c2b47b68956/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.357596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503f036-1f7c-4b65-b974-8c719bfd6a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb387f7cf0e4d96aa607a60612fb268, user_id=a0ff1f4c82ad4156927e4c2b47b68956, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.360315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503f036-1f7c-4b65-b974-8c719bfd6a50 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.374361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1116/2225] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:26 2022] PUT /identity/v3/projects/1fb387f7cf0e4d96aa607a60612fb268/users/a0ff1f4c82ad4156927e4c2b47b68956/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:26.384455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae304-55d5-43cc-91d6-326ed1e2821d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.384741 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae304-55d5-43cc-91d6-326ed1e2821d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.385108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae304-55d5-43cc-91d6-326ed1e2821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.413812 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-da7ae304-55d5-43cc-91d6-326ed1e2821d None None] MFA Rules not processed for user `a0ff1f4c82ad4156927e4c2b47b68956`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:26.415043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-da7ae304-55d5-43cc-91d6-326ed1e2821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:26.441688 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:26.486052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1110/2226] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:26.490839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f036-1f7c-4b65-b974-8c719bfd6a50 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.564936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f036-1f7c-4b65-b974-8c719bfd6a50 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.570039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd749b-1044-4d4e-a172-a1d340011371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.570685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd749b-1044-4d4e-a172-a1d340011371 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.570968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd749b-1044-4d4e-a172-a1d340011371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.571243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd749b-1044-4d4e-a172-a1d340011371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.571924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd749b-1044-4d4e-a172-a1d340011371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.573836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd749b-1044-4d4e-a172-a1d340011371 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.603777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1117/2227] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:26 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:26.608771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae304-55d5-43cc-91d6-326ed1e2821d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.620421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae304-55d5-43cc-91d6-326ed1e2821d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.678479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e9f5-597f-431e-a497-ff3b82dc148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.679110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e9f5-597f-431e-a497-ff3b82dc148f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.679393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e9f5-597f-431e-a497-ff3b82dc148f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.679665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e9f5-597f-431e-a497-ff3b82dc148f admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.680305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e9f5-597f-431e-a497-ff3b82dc148f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.682210 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e9f5-597f-431e-a497-ff3b82dc148f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.704351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1111/2228] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:26 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:26.708425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd749b-1044-4d4e-a172-a1d340011371 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.713924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:26.720157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd749b-1044-4d4e-a172-a1d340011371 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.725053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783737-9a0e-4bae-b813-868550fe13b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.725676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783737-9a0e-4bae-b813-868550fe13b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.725953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783737-9a0e-4bae-b813-868550fe13b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.726222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08783737-9a0e-4bae-b813-868550fe13b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.726899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08783737-9a0e-4bae-b813-868550fe13b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.728477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08783737-9a0e-4bae-b813-868550fe13b5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.739727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1118/2229] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:26.743920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e9f5-597f-431e-a497-ff3b82dc148f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.754475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e9f5-597f-431e-a497-ff3b82dc148f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.759031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d1816-2f1a-4e2a-aa39-0684b93ba59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.759663 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1816-2f1a-4e2a-aa39-0684b93ba59a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.759939 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1816-2f1a-4e2a-aa39-0684b93ba59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.760208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1816-2f1a-4e2a-aa39-0684b93ba59a admin admin] PATH_INFO: `/v3/projects/a88e925cc8984092a031c97afc8e5f02/users/1d12b4767f02497ba4f17495b1b3ca59/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.774390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d1816-2f1a-4e2a-aa39-0684b93ba59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88e925cc8984092a031c97afc8e5f02, user_id=1d12b4767f02497ba4f17495b1b3ca59, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.777071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d1816-2f1a-4e2a-aa39-0684b93ba59a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.789364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1112/2230] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:26 2022] PUT /identity/v3/projects/a88e925cc8984092a031c97afc8e5f02/users/1d12b4767f02497ba4f17495b1b3ca59/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:26.793252 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783737-9a0e-4bae-b813-868550fe13b5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.805528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08783737-9a0e-4bae-b813-868550fe13b5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.862724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05593b-d7b6-464c-930b-0f9802423f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.863313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05593b-d7b6-464c-930b-0f9802423f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.863597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05593b-d7b6-464c-930b-0f9802423f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.863869 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05593b-d7b6-464c-930b-0f9802423f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.864501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05593b-d7b6-464c-930b-0f9802423f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.866083 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05593b-d7b6-464c-930b-0f9802423f2f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.875860 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1119/2231] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:26.880094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d1816-2f1a-4e2a-aa39-0684b93ba59a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:26.892076 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d1816-2f1a-4e2a-aa39-0684b93ba59a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:26.896833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:26.897488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.897768 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.898047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] PATH_INFO: `/v3/projects/a88e925cc8984092a031c97afc8e5f02/users/1d12b4767f02497ba4f17495b1b3ca59/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.900011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88e925cc8984092a031c97afc8e5f02, user_id=1d12b4767f02497ba4f17495b1b3ca59, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:26.902694 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:26.913712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1113/2232] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:26 2022] PUT /identity/v3/projects/a88e925cc8984092a031c97afc8e5f02/users/1d12b4767f02497ba4f17495b1b3ca59/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:26.923967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef44b-8012-4794-b08b-3d309d1ec34f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:26.924303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef44b-8012-4794-b08b-3d309d1ec34f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:26.924582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef44b-8012-4794-b08b-3d309d1ec34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:26.953055 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d69ef44b-8012-4794-b08b-3d309d1ec34f None None] MFA Rules not processed for user `1d12b4767f02497ba4f17495b1b3ca59`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:26.954266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d69ef44b-8012-4794-b08b-3d309d1ec34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:27.045479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1120/2233] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:27.062266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:27.064327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:27.132176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560c7ca-2225-4af1-b292-84ffbc1711e4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:27.136355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:27.136850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:27.137126 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:27.137455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:27.147001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:27.148430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:27.159460 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1114/2234] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:27.202788 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef44b-8012-4794-b08b-3d309d1ec34f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:27.204230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d69ef44b-8012-4794-b08b-3d309d1ec34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:27.217495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef44b-8012-4794-b08b-3d309d1ec34f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:27.221332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f51e9a-524c-484a-a162-535a544efcac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:27.222473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f51e9a-524c-484a-a162-535a544efcac service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:27.222473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f51e9a-524c-484a-a162-535a544efcac service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:27.222473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f51e9a-524c-484a-a162-535a544efcac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:27.282277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f51e9a-524c-484a-a162-535a544efcac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:27.283745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f51e9a-524c-484a-a162-535a544efcac service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:27.293138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1121/2235] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:28.284815 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:28.286233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:28.313698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:28.346439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a367bd-56ae-44ac-ac08-47b2c8b11e64 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:28.350136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcee14-f501-4173-a2fd-bfe0bc218be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:28.350778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcee14-f501-4173-a2fd-bfe0bc218be7 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:28.351119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcee14-f501-4173-a2fd-bfe0bc218be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:28.351418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcee14-f501-4173-a2fd-bfe0bc218be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:28.353176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1dfcee14-f501-4173-a2fd-bfe0bc218be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:28.417515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcee14-f501-4173-a2fd-bfe0bc218be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:28.419052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcee14-f501-4173-a2fd-bfe0bc218be7 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:28.429436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1115/2236] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:30.389146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f51e9a-524c-484a-a162-535a544efcac service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:30.401907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f51e9a-524c-484a-a162-535a544efcac service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:30.407498 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:30.408137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:30.408416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:30.408691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] PATH_INFO: `/v3/users/e15396c975c1473eb20f38f59ba6cd35` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:30.409828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15396c975c1473eb20f38f59ba6cd35)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:30.412074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:30.417908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:30.478891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15396c975c1473eb20f38f59ba6cd35'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:30.479731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15396c975c1473eb20f38f59ba6cd35'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:30.489206 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15396c975c1473eb20f38f59ba6cd35'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:30.506168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15396c975c1473eb20f38f59ba6cd35'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:30.506909 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15396c975c1473eb20f38f59ba6cd35'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:30.522379 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1122/2237] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:30 2022] DELETE /identity/v3/users/e15396c975c1473eb20f38f59ba6cd35 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:30.526879 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24db86a-3b0c-464b-a9da-08f62415b629 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:30.527746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24db86a-3b0c-464b-a9da-08f62415b629 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:30.528277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24db86a-3b0c-464b-a9da-08f62415b629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:30.548970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f24db86a-3b0c-464b-a9da-08f62415b629 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:30.550490 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f24db86a-3b0c-464b-a9da-08f62415b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:30.621436 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1116/2238] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:30.633331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:30.634808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:30.709715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d548d8-a4b3-4009-a10a-b2d2d7bfd3cb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:30.713572 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc46cf-f48e-457d-a8c7-a1204d901c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:30.714335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc46cf-f48e-457d-a8c7-a1204d901c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:30.714470 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc46cf-f48e-457d-a8c7-a1204d901c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:30.715871 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc46cf-f48e-457d-a8c7-a1204d901c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:30.725859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc46cf-f48e-457d-a8c7-a1204d901c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:30.727374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc46cf-f48e-457d-a8c7-a1204d901c4a service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:30.737626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1123/2239] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:31.073831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24db86a-3b0c-464b-a9da-08f62415b629 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:31.076789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f24db86a-3b0c-464b-a9da-08f62415b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:31.096647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24db86a-3b0c-464b-a9da-08f62415b629 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:31.103946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:31.104769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:31.107044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:31.107567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] PATH_INFO: `/v3/projects/728912647830461f8ec85aa903e950a9` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:31.109177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] RBAC: Authorizing `identity:delete_project(project_id=728912647830461f8ec85aa903e950a9)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:31.112626 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:31.188079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728912647830461f8ec85aa903e950a9', 'request_id': 'req-31934813-95d3-4ecb-b3e4-a8bd7483a02b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.209541 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728912647830461f8ec85aa903e950a9', 'request_id': 'req-31934813-95d3-4ecb-b3e4-a8bd7483a02b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.217425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728912647830461f8ec85aa903e950a9', 'request_id': 'req-31934813-95d3-4ecb-b3e4-a8bd7483a02b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.222139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:31.233913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] The token cache is being invalidate because project 728912647830461f8ec85aa903e950a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:31.234388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.235564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.237443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1117/2240] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:31 2022] DELETE /identity/v3/projects/728912647830461f8ec85aa903e950a9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:31.241635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc46cf-f48e-457d-a8c7-a1204d901c4a service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:31.252746 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc46cf-f48e-457d-a8c7-a1204d901c4a service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:31.312856 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:31.313500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:31.313782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:31.314066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] PATH_INFO: `/v3/users/a0ff1f4c82ad4156927e4c2b47b68956` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:31.315311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ff1f4c82ad4156927e4c2b47b68956)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:31.317165 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:31.354885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:31.382414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ff1f4c82ad4156927e4c2b47b68956'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.384089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ff1f4c82ad4156927e4c2b47b68956'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.395587 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ff1f4c82ad4156927e4c2b47b68956'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.412540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ff1f4c82ad4156927e4c2b47b68956'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.413394 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ff1f4c82ad4156927e4c2b47b68956'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.431198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1124/2241] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:31 2022] DELETE /identity/v3/users/a0ff1f4c82ad4156927e4c2b47b68956 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:31.761646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:31.764788 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:31.786882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31934813-95d3-4ecb-b3e4-a8bd7483a02b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:31.885781 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:31.886884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:31.888093 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:31.889097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] PATH_INFO: `/v3/projects/1fb387f7cf0e4d96aa607a60612fb268` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:31.890404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb387f7cf0e4d96aa607a60612fb268)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:31.892454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:31.932577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:31.935278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:31.952521 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395398e7-3353-47c6-a88c-43f861016794 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:31.979263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb387f7cf0e4d96aa607a60612fb268', 'request_id': 'req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.986859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb387f7cf0e4d96aa607a60612fb268', 'request_id': 'req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:31.992773 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb387f7cf0e4d96aa607a60612fb268', 'request_id': 'req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.008142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] The token cache is being invalidate because project 1fb387f7cf0e4d96aa607a60612fb268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:32.008430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.009127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.010935 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1118/2242] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:31 2022] DELETE /identity/v3/projects/1fb387f7cf0e4d96aa607a60612fb268 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:32.015350 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.016738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.021779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.022471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.022778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.023074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] PATH_INFO: `/v3/users/05ace9c538754a1cad4a6dc9fc8b7bfb` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.024413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ace9c538754a1cad4a6dc9fc8b7bfb)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.026979 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.029716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1bb93-9ded-4262-a0f5-0201ba938d5b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.037347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.038102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.038513 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.038949 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] PATH_INFO: `/v3/users/1d12b4767f02497ba4f17495b1b3ca59` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.040418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d12b4767f02497ba4f17495b1b3ca59)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.042357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.094762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ace9c538754a1cad4a6dc9fc8b7bfb'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.095650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ace9c538754a1cad4a6dc9fc8b7bfb'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.101000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d12b4767f02497ba4f17495b1b3ca59'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.107214 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ace9c538754a1cad4a6dc9fc8b7bfb'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.115057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d12b4767f02497ba4f17495b1b3ca59'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.125549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d12b4767f02497ba4f17495b1b3ca59'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.126229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ace9c538754a1cad4a6dc9fc8b7bfb'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.126691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d12b4767f02497ba4f17495b1b3ca59'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.127974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ace9c538754a1cad4a6dc9fc8b7bfb'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.136147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d12b4767f02497ba4f17495b1b3ca59'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.138322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:32.149569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1119/2243] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:32 2022] DELETE /identity/v3/users/1d12b4767f02497ba4f17495b1b3ca59 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:32.152505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1125/2244] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:31 2022] DELETE /identity/v3/users/05ace9c538754a1cad4a6dc9fc8b7bfb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:32.155845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.156569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.228944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac10c73-6c91-4fba-ad2d-5e3c196641f5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.289731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.290575 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.290917 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.291253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.293132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.354317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.357528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.394652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:32.395044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.396993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.411040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1120/2245] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:32.453464 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57050b-2ab9-41ac-a262-5fdadae34441 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.454148 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.455629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.459858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.460893 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.461360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.461872 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] PATH_INFO: `/v3/projects/adeb4be372184d5496443a64c6cc545b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.463630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=adeb4be372184d5496443a64c6cc545b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.467450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.468560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d41df-7fbd-4274-8736-fd01b4e199fd service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.474844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.475986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.476269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.476545 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] PATH_INFO: `/v3/projects/a88e925cc8984092a031c97afc8e5f02` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.478592 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88e925cc8984092a031c97afc8e5f02)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.483307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.531557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adeb4be372184d5496443a64c6cc545b', 'request_id': 'req-0bef1e52-d73f-4028-b383-9ed1a713d7fc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.538482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adeb4be372184d5496443a64c6cc545b', 'request_id': 'req-0bef1e52-d73f-4028-b383-9ed1a713d7fc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.540996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88e925cc8984092a031c97afc8e5f02', 'request_id': 'req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.545084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adeb4be372184d5496443a64c6cc545b', 'request_id': 'req-0bef1e52-d73f-4028-b383-9ed1a713d7fc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.550336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88e925cc8984092a031c97afc8e5f02', 'request_id': 'req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.555308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:32.560326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88e925cc8984092a031c97afc8e5f02', 'request_id': 'req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.560512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] The token cache is being invalidate because project adeb4be372184d5496443a64c6cc545b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:32.560779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.561828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0bef1e52-d73f-4028-b383-9ed1a713d7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.563658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1126/2246] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:32 2022] DELETE /identity/v3/projects/adeb4be372184d5496443a64c6cc545b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:32.568423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588a70-6575-4be2-8478-4971497af661 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.568732 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588a70-6575-4be2-8478-4971497af661 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.569048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588a70-6575-4be2-8478-4971497af661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.577740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] The token cache is being invalidate because project a88e925cc8984092a031c97afc8e5f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:32.578165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.578934 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d9ff14c0-ecd6-4b9e-971d-e774ad7993e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:32.581363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1121/2247] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:32 2022] DELETE /identity/v3/projects/a88e925cc8984092a031c97afc8e5f02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:32.587100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37800-ae61-48ce-a489-54959218a0f6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.587459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37800-ae61-48ce-a489-54959218a0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.587848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37800-ae61-48ce-a489-54959218a0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.592925 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3d588a70-6575-4be2-8478-4971497af661 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:32.594147 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3d588a70-6575-4be2-8478-4971497af661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.611398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d7a37800-ae61-48ce-a489-54959218a0f6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:32.612814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d7a37800-ae61-48ce-a489-54959218a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.668234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1127/2248] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:32.676682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c096dc-7917-4329-a444-e2862b7b7dd3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.676970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c096dc-7917-4329-a444-e2862b7b7dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.677265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c096dc-7917-4329-a444-e2862b7b7dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.691152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1122/2249] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:32.698077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-05c096dc-7917-4329-a444-e2862b7b7dd3 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:32.699330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-05c096dc-7917-4329-a444-e2862b7b7dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.701207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add617-b8be-402a-b366-2598ad0cc874 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.701718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add617-b8be-402a-b366-2598ad0cc874 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.702066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add617-b8be-402a-b366-2598ad0cc874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.708162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1128/2250] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:32.712221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c096dc-7917-4329-a444-e2862b7b7dd3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.722047 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c096dc-7917-4329-a444-e2862b7b7dd3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.725862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-74add617-b8be-402a-b366-2598ad0cc874 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:32.726854 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.727456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.727736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.728011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.728142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-74add617-b8be-402a-b366-2598ad0cc874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:32.728658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:32.728950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.730564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.738654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1123/2251] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:32.741560 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74add617-b8be-402a-b366-2598ad0cc874 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.746361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1129/2252] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:05:32.747376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.752161 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74add617-b8be-402a-b366-2598ad0cc874 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.757648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.758356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e753b-fdb6-4b62-ac19-1018e10cd1c7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.758842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.759369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.759718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.760433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:32.760814 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.762975 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.764921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a97b7-8bb4-42e1-9852-d6f39c9176ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.765553 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a97b7-8bb4-42e1-9852-d6f39c9176ee admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.765837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a97b7-8bb4-42e1-9852-d6f39c9176ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.766641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a97b7-8bb4-42e1-9852-d6f39c9176ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.767309 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a97b7-8bb4-42e1-9852-d6f39c9176ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.769327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a97b7-8bb4-42e1-9852-d6f39c9176ee admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.780249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1124/2253] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:32.781361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.792988 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4be40-da41-4c4c-86b0-9f96b18c1aa3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.798522 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613d44-ce74-44a7-a782-a340adb99680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.799140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613d44-ce74-44a7-a782-a340adb99680 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.799415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613d44-ce74-44a7-a782-a340adb99680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.799682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613d44-ce74-44a7-a782-a340adb99680 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.800305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613d44-ce74-44a7-a782-a340adb99680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.804077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1130/2254] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:32 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:32.804219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613d44-ce74-44a7-a782-a340adb99680 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.805336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a97b7-8bb4-42e1-9852-d6f39c9176ee admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.822050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:32.837909 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1125/2255] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:32 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:32.842446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613d44-ce74-44a7-a782-a340adb99680 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.885014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a97b7-8bb4-42e1-9852-d6f39c9176ee admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.922816 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613d44-ce74-44a7-a782-a340adb99680 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:32.932796 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33546f-0f60-4038-9723-5cc3d9256fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.933548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33546f-0f60-4038-9723-5cc3d9256fbb admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.934461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33546f-0f60-4038-9723-5cc3d9256fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.935654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33546f-0f60-4038-9723-5cc3d9256fbb admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.936414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33546f-0f60-4038-9723-5cc3d9256fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.945363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33546f-0f60-4038-9723-5cc3d9256fbb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.977202 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85936faa-93cc-4c49-acd0-a494c54990ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:32.977886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936faa-93cc-4c49-acd0-a494c54990ad admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:32.978627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936faa-93cc-4c49-acd0-a494c54990ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:32.978627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936faa-93cc-4c49-acd0-a494c54990ad admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:32.979355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85936faa-93cc-4c49-acd0-a494c54990ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:32.980380 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1126/2256] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:32 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:32.982552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85936faa-93cc-4c49-acd0-a494c54990ad admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:32.984895 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33546f-0f60-4038-9723-5cc3d9256fbb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:32.996599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33546f-0f60-4038-9723-5cc3d9256fbb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.002130 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e47b84-5998-4ea4-a7bb-ff28d1c3e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.002864 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47b84-5998-4ea4-a7bb-ff28d1c3e0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.003264 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47b84-5998-4ea4-a7bb-ff28d1c3e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.003671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e47b84-5998-4ea4-a7bb-ff28d1c3e0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.004499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e47b84-5998-4ea4-a7bb-ff28d1c3e0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.006159 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e47b84-5998-4ea4-a7bb-ff28d1c3e0a1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.012116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1131/2257] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:32 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:33.017817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85936faa-93cc-4c49-acd0-a494c54990ad admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.022757 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1127/2258] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:33.024444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e47b84-5998-4ea4-a7bb-ff28d1c3e0a1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.033632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85936faa-93cc-4c49-acd0-a494c54990ad admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.040662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89ed4-d4dd-484c-8d90-5282d6b07e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.041387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89ed4-d4dd-484c-8d90-5282d6b07e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.041688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89ed4-d4dd-484c-8d90-5282d6b07e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.041949 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89ed4-d4dd-484c-8d90-5282d6b07e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.042644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f89ed4-d4dd-484c-8d90-5282d6b07e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.044027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e47b84-5998-4ea4-a7bb-ff28d1c3e0a1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.044838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f89ed4-d4dd-484c-8d90-5282d6b07e31 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.051006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c429f5-d55f-4063-95c9-20495bcd604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.052072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c429f5-d55f-4063-95c9-20495bcd604a admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.053046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c429f5-d55f-4063-95c9-20495bcd604a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.053581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c429f5-d55f-4063-95c9-20495bcd604a admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.055336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c429f5-d55f-4063-95c9-20495bcd604a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.057073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1132/2259] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:33.057422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c429f5-d55f-4063-95c9-20495bcd604a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.060943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89ed4-d4dd-484c-8d90-5282d6b07e31 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.074203 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89ed4-d4dd-484c-8d90-5282d6b07e31 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.079417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1128/2260] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:33.080840 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c429f5-d55f-4063-95c9-20495bcd604a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.083067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88907b76-cebd-4bdd-b152-ef5be20ab602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.083764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88907b76-cebd-4bdd-b152-ef5be20ab602 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.084113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88907b76-cebd-4bdd-b152-ef5be20ab602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.084454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88907b76-cebd-4bdd-b152-ef5be20ab602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.085211 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88907b76-cebd-4bdd-b152-ef5be20ab602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.087177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88907b76-cebd-4bdd-b152-ef5be20ab602 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.093409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c429f5-d55f-4063-95c9-20495bcd604a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.098995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5eb1f-3e4d-45c6-a05f-41cc801c54b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.099899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5eb1f-3e4d-45c6-a05f-41cc801c54b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.100336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5eb1f-3e4d-45c6-a05f-41cc801c54b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.100798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5eb1f-3e4d-45c6-a05f-41cc801c54b5 admin admin] PATH_INFO: `/v3/projects/16ab7f5fe41e4a859d6dc765572cb3d2/users/06a08a6c175a44819d9990ea6d42c092/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.107103 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1133/2261] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:33.108144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88907b76-cebd-4bdd-b152-ef5be20ab602 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.119289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:33.119540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88907b76-cebd-4bdd-b152-ef5be20ab602 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.127947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5eb1f-3e4d-45c6-a05f-41cc801c54b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ab7f5fe41e4a859d6dc765572cb3d2, user_id=06a08a6c175a44819d9990ea6d42c092, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.131085 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66fcb-15c2-4dfd-9544-0e54a37dd28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.131758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66fcb-15c2-4dfd-9544-0e54a37dd28a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.132032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66fcb-15c2-4dfd-9544-0e54a37dd28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.132633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66fcb-15c2-4dfd-9544-0e54a37dd28a admin admin] PATH_INFO: `/v3/projects/9abf018bacc44dfc8287403d522744f0/users/0bba2005e6fd44908df978e0061fa2d3/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.134921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5eb1f-3e4d-45c6-a05f-41cc801c54b5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.154879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f66fcb-15c2-4dfd-9544-0e54a37dd28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abf018bacc44dfc8287403d522744f0, user_id=0bba2005e6fd44908df978e0061fa2d3, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.157642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1129/2262] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:33 2022] PUT /identity/v3/projects/16ab7f5fe41e4a859d6dc765572cb3d2/users/06a08a6c175a44819d9990ea6d42c092/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:33.158362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f66fcb-15c2-4dfd-9544-0e54a37dd28a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.170129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949d1f-5060-4b51-ba52-e971433fa908 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.170467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949d1f-5060-4b51-ba52-e971433fa908 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.170737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2949d1f-5060-4b51-ba52-e971433fa908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.190617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1134/2263] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:33 2022] PUT /identity/v3/projects/9abf018bacc44dfc8287403d522744f0/users/0bba2005e6fd44908df978e0061fa2d3/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:33.199781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac9f0-80dc-44db-bcc9-39a82fd62f45 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.200273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac9f0-80dc-44db-bcc9-39a82fd62f45 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.200708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac9f0-80dc-44db-bcc9-39a82fd62f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.207916 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d2949d1f-5060-4b51-ba52-e971433fa908 None None] MFA Rules not processed for user `06a08a6c175a44819d9990ea6d42c092`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:33.209339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d2949d1f-5060-4b51-ba52-e971433fa908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:33.241450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cddac9f0-80dc-44db-bcc9-39a82fd62f45 None None] MFA Rules not processed for user `0bba2005e6fd44908df978e0061fa2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:33.242724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cddac9f0-80dc-44db-bcc9-39a82fd62f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:33.284165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1130/2264] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:33.288880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2949d1f-5060-4b51-ba52-e971433fa908 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.313548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:33.329313 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1135/2265] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:33.333573 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddac9f0-80dc-44db-bcc9-39a82fd62f45 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.367936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2949d1f-5060-4b51-ba52-e971433fa908 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.373698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4002dc3-4f89-44d0-bc15-b1050aa4df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.373958 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4002dc3-4f89-44d0-bc15-b1050aa4df88 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.374238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4002dc3-4f89-44d0-bc15-b1050aa4df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.374510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4002dc3-4f89-44d0-bc15-b1050aa4df88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.375182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4002dc3-4f89-44d0-bc15-b1050aa4df88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.377096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4002dc3-4f89-44d0-bc15-b1050aa4df88 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.410766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1131/2266] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:33 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:33.414271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4002dc3-4f89-44d0-bc15-b1050aa4df88 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.415705 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddac9f0-80dc-44db-bcc9-39a82fd62f45 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.483151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d76fa-8682-4fe1-8b4d-dce9b08809f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.483845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d76fa-8682-4fe1-8b4d-dce9b08809f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.484057 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d76fa-8682-4fe1-8b4d-dce9b08809f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.484537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d76fa-8682-4fe1-8b4d-dce9b08809f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.485240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d76fa-8682-4fe1-8b4d-dce9b08809f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.487589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d76fa-8682-4fe1-8b4d-dce9b08809f5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.491343 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4002dc3-4f89-44d0-bc15-b1050aa4df88 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.497224 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722090a-7011-4fcc-86f4-5a749085ba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.498511 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722090a-7011-4fcc-86f4-5a749085ba40 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.498893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722090a-7011-4fcc-86f4-5a749085ba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.499270 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722090a-7011-4fcc-86f4-5a749085ba40 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.499994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722090a-7011-4fcc-86f4-5a749085ba40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.502066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722090a-7011-4fcc-86f4-5a749085ba40 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.516172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:33.530948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1136/2267] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:33 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:33.532088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d76fa-8682-4fe1-8b4d-dce9b08809f5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.537605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1132/2268] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:33 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:33.538510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722090a-7011-4fcc-86f4-5a749085ba40 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.549603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722090a-7011-4fcc-86f4-5a749085ba40 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.615664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d76fa-8682-4fe1-8b4d-dce9b08809f5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.618483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214d2b9-b263-45b7-b09e-4f6a34fd89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.619267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d2b9-b263-45b7-b09e-4f6a34fd89f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.619615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d2b9-b263-45b7-b09e-4f6a34fd89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.619995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d2b9-b263-45b7-b09e-4f6a34fd89f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.620478 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b21ac1-5c51-4cb6-8e19-5b08044c90e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.620859 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214d2b9-b263-45b7-b09e-4f6a34fd89f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.621094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21ac1-5c51-4cb6-8e19-5b08044c90e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.621450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21ac1-5c51-4cb6-8e19-5b08044c90e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.622900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21ac1-5c51-4cb6-8e19-5b08044c90e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.623566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b21ac1-5c51-4cb6-8e19-5b08044c90e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.623929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214d2b9-b263-45b7-b09e-4f6a34fd89f5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.625509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b21ac1-5c51-4cb6-8e19-5b08044c90e2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.635137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1133/2269] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:33.640577 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214d2b9-b263-45b7-b09e-4f6a34fd89f5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.652296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214d2b9-b263-45b7-b09e-4f6a34fd89f5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.654684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1137/2270] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:33 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:33.657512 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b21ac1-5c51-4cb6-8e19-5b08044c90e2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.658349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba657e2-dd51-49c5-9fd1-f0496190946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.659038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba657e2-dd51-49c5-9fd1-f0496190946e admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.659319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba657e2-dd51-49c5-9fd1-f0496190946e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.659597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba657e2-dd51-49c5-9fd1-f0496190946e admin admin] PATH_INFO: `/v3/projects/137476d91e9740fa966b0beb79b6257c/users/8af3677e30f847afb37aa1b439a67515/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.669591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b21ac1-5c51-4cb6-8e19-5b08044c90e2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.674845 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea554f33-eacb-4eae-854f-96bf2fee48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.675628 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554f33-eacb-4eae-854f-96bf2fee48a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.675920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554f33-eacb-4eae-854f-96bf2fee48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.676199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554f33-eacb-4eae-854f-96bf2fee48a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.677026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea554f33-eacb-4eae-854f-96bf2fee48a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.677576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba657e2-dd51-49c5-9fd1-f0496190946e admin admin] RBAC: Authorizing `identity:create_grant(project_id=137476d91e9740fa966b0beb79b6257c, user_id=8af3677e30f847afb37aa1b439a67515, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.678698 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea554f33-eacb-4eae-854f-96bf2fee48a5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.680876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba657e2-dd51-49c5-9fd1-f0496190946e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.697965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1134/2271] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:33 2022] PUT /identity/v3/projects/137476d91e9740fa966b0beb79b6257c/users/8af3677e30f847afb37aa1b439a67515/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:33.698633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1138/2272] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:33.701315 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba657e2-dd51-49c5-9fd1-f0496190946e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.703816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea554f33-eacb-4eae-854f-96bf2fee48a5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.712727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:33.715794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea554f33-eacb-4eae-854f-96bf2fee48a5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.806905 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba657e2-dd51-49c5-9fd1-f0496190946e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.808258 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8f9b-965a-4cd3-869d-b08bfd86abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.809012 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8f9b-965a-4cd3-869d-b08bfd86abde admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.809410 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8f9b-965a-4cd3-869d-b08bfd86abde admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.809838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8f9b-965a-4cd3-869d-b08bfd86abde admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.810688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c8f9b-965a-4cd3-869d-b08bfd86abde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.812524 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c8f9b-965a-4cd3-869d-b08bfd86abde admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.812906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7b7b3-5963-4f1f-b5b9-dadcf13d311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.813929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b7b3-5963-4f1f-b5b9-dadcf13d311a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.814384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b7b3-5963-4f1f-b5b9-dadcf13d311a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.814709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b7b3-5963-4f1f-b5b9-dadcf13d311a admin admin] PATH_INFO: `/v3/projects/ca95ba206a9e48449ccf9535014511d7/users/897f7267072a474899f4f576b5ae0b5f/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.831295 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1139/2273] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:33.833014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8f9b-965a-4cd3-869d-b08bfd86abde admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.833165 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7b7b3-5963-4f1f-b5b9-dadcf13d311a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca95ba206a9e48449ccf9535014511d7, user_id=897f7267072a474899f4f576b5ae0b5f, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.836450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7b7b3-5963-4f1f-b5b9-dadcf13d311a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.845908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8f9b-965a-4cd3-869d-b08bfd86abde admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:33.853200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba9db-83a5-4c03-a1b9-8e135371d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:33.853735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba9db-83a5-4c03-a1b9-8e135371d6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.854188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba9db-83a5-4c03-a1b9-8e135371d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.854633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba9db-83a5-4c03-a1b9-8e135371d6a2 admin admin] PATH_INFO: `/v3/projects/137476d91e9740fa966b0beb79b6257c/users/8af3677e30f847afb37aa1b439a67515/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.857266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba9db-83a5-4c03-a1b9-8e135371d6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137476d91e9740fa966b0beb79b6257c, user_id=8af3677e30f847afb37aa1b439a67515, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:33.859444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1135/2274] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:33 2022] PUT /identity/v3/projects/ca95ba206a9e48449ccf9535014511d7/users/897f7267072a474899f4f576b5ae0b5f/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:33.860171 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba9db-83a5-4c03-a1b9-8e135371d6a2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:33.863915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7b7b3-5963-4f1f-b5b9-dadcf13d311a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:33.878003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1140/2275] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:33 2022] PUT /identity/v3/projects/137476d91e9740fa966b0beb79b6257c/users/8af3677e30f847afb37aa1b439a67515/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:33.890156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3267e54-cb14-446e-843f-6981923698de None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:33.890508 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3267e54-cb14-446e-843f-6981923698de None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:33.890760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3267e54-cb14-446e-843f-6981923698de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:33.929503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d3267e54-cb14-446e-843f-6981923698de None None] MFA Rules not processed for user `8af3677e30f847afb37aa1b439a67515`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:33.929503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d3267e54-cb14-446e-843f-6981923698de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:33.958854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:33.978153 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7b7b3-5963-4f1f-b5b9-dadcf13d311a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:34.015288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1141/2276] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:34.023329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3267e54-cb14-446e-843f-6981923698de None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:34.025342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d3267e54-cb14-446e-843f-6981923698de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:34.045173 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e353e7d-4611-4e17-857e-c2f2d69970cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:34.045793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353e7d-4611-4e17-857e-c2f2d69970cc admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:34.046077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353e7d-4611-4e17-857e-c2f2d69970cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:34.046354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353e7d-4611-4e17-857e-c2f2d69970cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:34.047125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e353e7d-4611-4e17-857e-c2f2d69970cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:34.049418 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e353e7d-4611-4e17-857e-c2f2d69970cc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:34.063956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1136/2277] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:34.064875 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e353e7d-4611-4e17-857e-c2f2d69970cc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:34.076100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e353e7d-4611-4e17-857e-c2f2d69970cc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:34.081354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c6a2-01f6-4475-a3e6-8fbc042362e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:34.082013 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c6a2-01f6-4475-a3e6-8fbc042362e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:34.082341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c6a2-01f6-4475-a3e6-8fbc042362e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:34.082734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c6a2-01f6-4475-a3e6-8fbc042362e6 admin admin] PATH_INFO: `/v3/projects/ca95ba206a9e48449ccf9535014511d7/users/897f7267072a474899f4f576b5ae0b5f/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:34.084761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275c6a2-01f6-4475-a3e6-8fbc042362e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca95ba206a9e48449ccf9535014511d7, user_id=897f7267072a474899f4f576b5ae0b5f, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:34.087567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275c6a2-01f6-4475-a3e6-8fbc042362e6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:34.091900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3267e54-cb14-446e-843f-6981923698de None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:34.096862 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:34.097473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:34.098235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:34.098552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:34.100119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1137/2278] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:34 2022] PUT /identity/v3/projects/ca95ba206a9e48449ccf9535014511d7/users/897f7267072a474899f4f576b5ae0b5f/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:34.111354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1de82-df6a-49d8-9df0-e3f76654ff2b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:34.111665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1de82-df6a-49d8-9df0-e3f76654ff2b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:34.111987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1de82-df6a-49d8-9df0-e3f76654ff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:34.112705 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:34.114158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:34.126062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1142/2279] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:34.126806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:34.128414 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:34.145460 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-fcf1de82-df6a-49d8-9df0-e3f76654ff2b None None] MFA Rules not processed for user `897f7267072a474899f4f576b5ae0b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:34.147247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fcf1de82-df6a-49d8-9df0-e3f76654ff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:34.151654 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:34.201364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d3674-4085-419b-8271-638134aae7d3 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:34.244032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1138/2280] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:34.254416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1de82-df6a-49d8-9df0-e3f76654ff2b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:34.278474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:34.279284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:34.279665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:34.281432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:34.285584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:34.331532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1de82-df6a-49d8-9df0-e3f76654ff2b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:34.336169 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908045-1bf6-4aea-80d0-b7a85794d446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:34.337632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908045-1bf6-4aea-80d0-b7a85794d446 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:34.337903 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908045-1bf6-4aea-80d0-b7a85794d446 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:34.338180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908045-1bf6-4aea-80d0-b7a85794d446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:34.368827 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:34.399116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:34.401423 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:34.414362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1143/2281] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:34.435858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908045-1bf6-4aea-80d0-b7a85794d446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:34.437451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908045-1bf6-4aea-80d0-b7a85794d446 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:34.461745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1139/2282] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:35.182035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:35.287911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3451350-df9f-462b-b71e-87f30d4a1425 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:35.292630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:35.293318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:35.294138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:35.294413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] PATH_INFO: `/v3/users/06a08a6c175a44819d9990ea6d42c092` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:35.295652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a08a6c175a44819d9990ea6d42c092)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:35.297584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:35.335240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:35.358714 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a08a6c175a44819d9990ea6d42c092'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:35.359383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a08a6c175a44819d9990ea6d42c092'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:35.370310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a08a6c175a44819d9990ea6d42c092'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:35.386903 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a08a6c175a44819d9990ea6d42c092'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:35.388522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a08a6c175a44819d9990ea6d42c092'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:35.405093 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1144/2283] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:35 2022] DELETE /identity/v3/users/06a08a6c175a44819d9990ea6d42c092 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:35.409347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f998-e413-4f31-9c59-e427da9c0c2e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:35.409865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f998-e413-4f31-9c59-e427da9c0c2e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:35.409971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f998-e413-4f31-9c59-e427da9c0c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:35.431497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5948f998-e413-4f31-9c59-e427da9c0c2e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:35.433140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5948f998-e413-4f31-9c59-e427da9c0c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:35.508606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1140/2284] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:35.520482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:35.521969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:35.627725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911ef04-86fa-4c70-83bf-2c028325a46d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:35.631670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5782a-c688-401b-9266-d6bb7e16a75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:35.632297 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5782a-c688-401b-9266-d6bb7e16a75d service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:35.632582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5782a-c688-401b-9266-d6bb7e16a75d service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:35.632901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5782a-c688-401b-9266-d6bb7e16a75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:35.643506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5782a-c688-401b-9266-d6bb7e16a75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:35.644956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5782a-c688-401b-9266-d6bb7e16a75d service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:35.656508 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1145/2285] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:36.414503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f998-e413-4f31-9c59-e427da9c0c2e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:36.417709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5948f998-e413-4f31-9c59-e427da9c0c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:36.449107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f998-e413-4f31-9c59-e427da9c0c2e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:36.458365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:36.459208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:36.459820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:36.459986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] PATH_INFO: `/v3/projects/16ab7f5fe41e4a859d6dc765572cb3d2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:36.461433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ab7f5fe41e4a859d6dc765572cb3d2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:36.469160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:36.563231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ab7f5fe41e4a859d6dc765572cb3d2', 'request_id': 'req-6e39f624-69f5-4ede-b775-2c790edf95d9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.577941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ab7f5fe41e4a859d6dc765572cb3d2', 'request_id': 'req-6e39f624-69f5-4ede-b775-2c790edf95d9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.586685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ab7f5fe41e4a859d6dc765572cb3d2', 'request_id': 'req-6e39f624-69f5-4ede-b775-2c790edf95d9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.603997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] The token cache is being invalidate because project 16ab7f5fe41e4a859d6dc765572cb3d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:36.604242 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.604795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.607700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1141/2286] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:36 2022] DELETE /identity/v3/projects/16ab7f5fe41e4a859d6dc765572cb3d2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:36.612444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5782a-c688-401b-9266-d6bb7e16a75d service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:36.624399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5782a-c688-401b-9266-d6bb7e16a75d service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:36.701284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:36.701786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:36.702140 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:36.702630 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] PATH_INFO: `/v3/users/8af3677e30f847afb37aa1b439a67515` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:36.704037 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af3677e30f847afb37aa1b439a67515)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:36.706331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:36.776088 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af3677e30f847afb37aa1b439a67515'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.777099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af3677e30f847afb37aa1b439a67515'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.781842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:36.787927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af3677e30f847afb37aa1b439a67515'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.800484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:36.802620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:36.808207 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af3677e30f847afb37aa1b439a67515'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.809333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af3677e30f847afb37aa1b439a67515'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.827265 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39f624-69f5-4ede-b775-2c790edf95d9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:36.830338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1146/2287] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:36 2022] DELETE /identity/v3/users/8af3677e30f847afb37aa1b439a67515 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:36.833481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:36.833481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:36.833481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:36.833481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] PATH_INFO: `/v3/users/0046dc0cc60049ae8ea43797c84aef61` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:36.834558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0046dc0cc60049ae8ea43797c84aef61)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:36.836600 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:36.881204 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:36.895431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0046dc0cc60049ae8ea43797c84aef61'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.916268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0046dc0cc60049ae8ea43797c84aef61'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.926696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0046dc0cc60049ae8ea43797c84aef61'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.927798 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0046dc0cc60049ae8ea43797c84aef61'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.940047 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0046dc0cc60049ae8ea43797c84aef61'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:36.948304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1142/2288] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:36 2022] DELETE /identity/v3/users/0046dc0cc60049ae8ea43797c84aef61 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:37.189316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.190463 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.191271 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:37.192422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:37.291576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc6b71-185f-4e1d-9eae-580703aac950 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.296915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.297673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.298017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.298353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] PATH_INFO: `/v3/projects/137476d91e9740fa966b0beb79b6257c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.299656 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137476d91e9740fa966b0beb79b6257c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.301991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.304841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b284475-37f8-45e8-bbf6-33f7d48bb362 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.310052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.310657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.310969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.311242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] PATH_INFO: `/v3/projects/4514345efc0145fcbcf0292f4048b9ef` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.312427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4514345efc0145fcbcf0292f4048b9ef)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.314554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.375542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137476d91e9740fa966b0beb79b6257c', 'request_id': 'req-298dec3d-b29b-4599-9a7f-7140f01d2386'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.376564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4514345efc0145fcbcf0292f4048b9ef', 'request_id': 'req-80d9e8df-5c87-4d8f-97f7-c947c207f663'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.383586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137476d91e9740fa966b0beb79b6257c', 'request_id': 'req-298dec3d-b29b-4599-9a7f-7140f01d2386'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.387523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4514345efc0145fcbcf0292f4048b9ef', 'request_id': 'req-80d9e8df-5c87-4d8f-97f7-c947c207f663'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.391546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137476d91e9740fa966b0beb79b6257c', 'request_id': 'req-298dec3d-b29b-4599-9a7f-7140f01d2386'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.401028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4514345efc0145fcbcf0292f4048b9ef', 'request_id': 'req-80d9e8df-5c87-4d8f-97f7-c947c207f663'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.410351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] The token cache is being invalidate because project 137476d91e9740fa966b0beb79b6257c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:37.410706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.411470 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-298dec3d-b29b-4599-9a7f-7140f01d2386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.413693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1143/2289] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:37 2022] DELETE /identity/v3/projects/137476d91e9740fa966b0beb79b6257c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:37.417290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] The token cache is being invalidate because project 4514345efc0145fcbcf0292f4048b9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:37.417924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.418720 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-80d9e8df-5c87-4d8f-97f7-c947c207f663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:37.419052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266ec48-98e9-455a-975f-c456ff2eced0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.419547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266ec48-98e9-455a-975f-c456ff2eced0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.419655 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266ec48-98e9-455a-975f-c456ff2eced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.422646 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1147/2290] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:37 2022] DELETE /identity/v3/projects/4514345efc0145fcbcf0292f4048b9ef => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:37.425791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e863-d11a-4135-98b3-6164c22de177 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.426080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e863-d11a-4135-98b3-6164c22de177 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.426356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e863-d11a-4135-98b3-6164c22de177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.441317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a266ec48-98e9-455a-975f-c456ff2eced0 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:37.442703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a266ec48-98e9-455a-975f-c456ff2eced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:37.450771 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9c27e863-d11a-4135-98b3-6164c22de177 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:37.451986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9c27e863-d11a-4135-98b3-6164c22de177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:37.489037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:37.524652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:37.526440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1144/2291] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:37.527201 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266ec48-98e9-455a-975f-c456ff2eced0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.529026 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a266ec48-98e9-455a-975f-c456ff2eced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:37.543980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1148/2292] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:37.547879 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ab5a-7532-41f0-9eae-fcf4ac1fe063 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.548161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ab5a-7532-41f0-9eae-fcf4ac1fe063 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.548429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ab5a-7532-41f0-9eae-fcf4ac1fe063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.569186 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6282ab5a-7532-41f0-9eae-fcf4ac1fe063 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:37.570387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6282ab5a-7532-41f0-9eae-fcf4ac1fe063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:37.579725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1149/2293] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:37.580836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0064-8dbc-4521-ad9d-56bb233e2902 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.581302 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0064-8dbc-4521-ad9d-56bb233e2902 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.581523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0064-8dbc-4521-ad9d-56bb233e2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.600910 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0e7d0064-8dbc-4521-ad9d-56bb233e2902 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:37.602125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266ec48-98e9-455a-975f-c456ff2eced0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.602272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0e7d0064-8dbc-4521-ad9d-56bb233e2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:37.606586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.607192 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.607472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.607765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.609863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:37.611749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1150/2294] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:37.612545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d0064-8dbc-4521-ad9d-56bb233e2902 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.622290 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d0064-8dbc-4521-ad9d-56bb233e2902 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.627333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.627926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.628205 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.628477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.629129 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:37.629429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.631051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.647723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1151/2295] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:37.647723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.659791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efa943-eb17-4426-8949-5f3530e6cf72 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.665355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.665953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.666234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.666506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.667200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:37.667502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.669120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.682848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1152/2296] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:37.684146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.687573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.689043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.693852 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bcacf-fea3-4ae2-ba78-3633b83bec7b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.698376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7613eba-c756-40e5-b1b5-75566c7516ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.698992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613eba-c756-40e5-b1b5-75566c7516ab admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.699113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1145/2297] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:37.700029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613eba-c756-40e5-b1b5-75566c7516ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.700274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613eba-c756-40e5-b1b5-75566c7516ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.700388 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.700899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7613eba-c756-40e5-b1b5-75566c7516ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.702804 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7613eba-c756-40e5-b1b5-75566c7516ab admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.710846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164479d-e5a0-4573-acba-0493c65ad8d2 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.716583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585dfb5-a24a-4119-a6ce-d2d4a4c28a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.717185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585dfb5-a24a-4119-a6ce-d2d4a4c28a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.717469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585dfb5-a24a-4119-a6ce-d2d4a4c28a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.717740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585dfb5-a24a-4119-a6ce-d2d4a4c28a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.718366 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585dfb5-a24a-4119-a6ce-d2d4a4c28a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.720403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585dfb5-a24a-4119-a6ce-d2d4a4c28a1f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.732444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1153/2298] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:37 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:37.736637 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7613eba-c756-40e5-b1b5-75566c7516ab admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.759502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1146/2299] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:37 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:37.761043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585dfb5-a24a-4119-a6ce-d2d4a4c28a1f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.843856 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7613eba-c756-40e5-b1b5-75566c7516ab admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.849000 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585dfb5-a24a-4119-a6ce-d2d4a4c28a1f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.850048 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd9df-9403-4615-99ef-55fc9f5995fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.850961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd9df-9403-4615-99ef-55fc9f5995fd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.851418 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd9df-9403-4615-99ef-55fc9f5995fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.851932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd9df-9403-4615-99ef-55fc9f5995fd admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.852842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fd9df-9403-4615-99ef-55fc9f5995fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.854773 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce64c-e8ea-47d9-ad9b-f5346a1ad263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.855334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fd9df-9403-4615-99ef-55fc9f5995fd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.856185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce64c-e8ea-47d9-ad9b-f5346a1ad263 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.856553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce64c-e8ea-47d9-ad9b-f5346a1ad263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.857071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce64c-e8ea-47d9-ad9b-f5346a1ad263 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.857790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce64c-e8ea-47d9-ad9b-f5346a1ad263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.860156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce64c-e8ea-47d9-ad9b-f5346a1ad263 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.892956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1154/2300] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:37 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:37.893974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd9df-9403-4615-99ef-55fc9f5995fd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.905349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1147/2301] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:37 2022] POST /identity/v3/users => generated 303 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:37.909041 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce64c-e8ea-47d9-ad9b-f5346a1ad263 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.915795 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd9df-9403-4615-99ef-55fc9f5995fd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.916672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:37.923678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890f2d-928b-4f92-aa85-769d97638ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.924388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890f2d-928b-4f92-aa85-769d97638ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.924789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890f2d-928b-4f92-aa85-769d97638ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.925321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890f2d-928b-4f92-aa85-769d97638ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.925990 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890f2d-928b-4f92-aa85-769d97638ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.928123 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce64c-e8ea-47d9-ad9b-f5346a1ad263 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.931890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890f2d-928b-4f92-aa85-769d97638ed6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.934784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884883-3f40-48c9-a4ea-706289e41d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.935605 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884883-3f40-48c9-a4ea-706289e41d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.936048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884883-3f40-48c9-a4ea-706289e41d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.938016 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884883-3f40-48c9-a4ea-706289e41d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.939082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884883-3f40-48c9-a4ea-706289e41d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.943292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884883-3f40-48c9-a4ea-706289e41d89 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.948668 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1155/2302] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:37.953073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890f2d-928b-4f92-aa85-769d97638ed6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.960196 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1148/2303] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:37.964233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884883-3f40-48c9-a4ea-706289e41d89 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:37.973557 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890f2d-928b-4f92-aa85-769d97638ed6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.979802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884883-3f40-48c9-a4ea-706289e41d89 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:37.980929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3530a-5174-4207-969b-e79813cd7a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.981625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3530a-5174-4207-969b-e79813cd7a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.981983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3530a-5174-4207-969b-e79813cd7a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.982946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3530a-5174-4207-969b-e79813cd7a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.984500 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3530a-5174-4207-969b-e79813cd7a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.987242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3530a-5174-4207-969b-e79813cd7a0f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:37.989738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec67dc0-cfd6-46d5-9b21-49081706d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:37.992304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec67dc0-cfd6-46d5-9b21-49081706d20d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:37.993198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec67dc0-cfd6-46d5-9b21-49081706d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:37.994872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec67dc0-cfd6-46d5-9b21-49081706d20d admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:37.997005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec67dc0-cfd6-46d5-9b21-49081706d20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:37.998953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec67dc0-cfd6-46d5-9b21-49081706d20d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.001859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1156/2304] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:38.007148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3530a-5174-4207-969b-e79813cd7a0f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.014790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1149/2305] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:38.018979 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec67dc0-cfd6-46d5-9b21-49081706d20d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.026277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3530a-5174-4207-969b-e79813cd7a0f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.034191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec67dc0-cfd6-46d5-9b21-49081706d20d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.037951 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea171116-9481-4579-bd64-30adaf27925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.041029 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171116-9481-4579-bd64-30adaf27925a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.041402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171116-9481-4579-bd64-30adaf27925a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.041761 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171116-9481-4579-bd64-30adaf27925a admin admin] PATH_INFO: `/v3/projects/8512d23b0eba4c01a2ffdf43b91de9d2/users/e24fbb91a07d430f830743aa0c519a39/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.042040 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144d838-f36a-42e4-8f0f-71cc8cd528f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.043899 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d838-f36a-42e4-8f0f-71cc8cd528f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.044433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d838-f36a-42e4-8f0f-71cc8cd528f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.045136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d838-f36a-42e4-8f0f-71cc8cd528f5 admin admin] PATH_INFO: `/v3/projects/f32f3fc671d04e01b87124f07a758b06/users/cc031becf534427ba70390543a2f4096/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.065649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea171116-9481-4579-bd64-30adaf27925a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8512d23b0eba4c01a2ffdf43b91de9d2, user_id=e24fbb91a07d430f830743aa0c519a39, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.066082 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144d838-f36a-42e4-8f0f-71cc8cd528f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32f3fc671d04e01b87124f07a758b06, user_id=cc031becf534427ba70390543a2f4096, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.068574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea171116-9481-4579-bd64-30adaf27925a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.069419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144d838-f36a-42e4-8f0f-71cc8cd528f5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.089331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1157/2306] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:38 2022] PUT /identity/v3/projects/8512d23b0eba4c01a2ffdf43b91de9d2/users/e24fbb91a07d430f830743aa0c519a39/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:38.091646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1150/2307] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:38 2022] PUT /identity/v3/projects/f32f3fc671d04e01b87124f07a758b06/users/cc031becf534427ba70390543a2f4096/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:38.100394 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b0be-3a79-42d2-b568-cc0ef455d8d6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.100805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b0be-3a79-42d2-b568-cc0ef455d8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.101722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b0be-3a79-42d2-b568-cc0ef455d8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.102421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a90d-4150-4900-8b34-29ed005a94d7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.102801 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a90d-4150-4900-8b34-29ed005a94d7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.103096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a90d-4150-4900-8b34-29ed005a94d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.147070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6348a90d-4150-4900-8b34-29ed005a94d7 None None] MFA Rules not processed for user `cc031becf534427ba70390543a2f4096`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:38.148424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6348a90d-4150-4900-8b34-29ed005a94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:38.161937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e624b0be-3a79-42d2-b568-cc0ef455d8d6 None None] MFA Rules not processed for user `e24fbb91a07d430f830743aa0c519a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:38.163802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e624b0be-3a79-42d2-b568-cc0ef455d8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:38.201891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:38.236213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1151/2308] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:38 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:38.240748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348a90d-4150-4900-8b34-29ed005a94d7 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.248350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1158/2309] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:38.252956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624b0be-3a79-42d2-b568-cc0ef455d8d6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.332325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348a90d-4150-4900-8b34-29ed005a94d7 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.337412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8442f49-d91e-4b72-a350-beca6803d42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.338036 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442f49-d91e-4b72-a350-beca6803d42e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.338331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442f49-d91e-4b72-a350-beca6803d42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.338644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442f49-d91e-4b72-a350-beca6803d42e admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.338792 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624b0be-3a79-42d2-b568-cc0ef455d8d6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.339341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8442f49-d91e-4b72-a350-beca6803d42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.341882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8442f49-d91e-4b72-a350-beca6803d42e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.344657 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2cd2-2996-4873-9f7d-a6a45bb73b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.345321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2cd2-2996-4873-9f7d-a6a45bb73b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.345786 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2cd2-2996-4873-9f7d-a6a45bb73b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.346080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2cd2-2996-4873-9f7d-a6a45bb73b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.347035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d2cd2-2996-4873-9f7d-a6a45bb73b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.349597 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d2cd2-2996-4873-9f7d-a6a45bb73b97 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.377326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1152/2310] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:38 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:38.381415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8442f49-d91e-4b72-a350-beca6803d42e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.395492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1159/2311] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:38 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:38.396730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2cd2-2996-4873-9f7d-a6a45bb73b97 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.428696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:38.465693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8442f49-d91e-4b72-a350-beca6803d42e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.483651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2cd2-2996-4873-9f7d-a6a45bb73b97 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.490462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f2da1-5586-407d-b291-2dbeb741aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.491454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f2da1-5586-407d-b291-2dbeb741aed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.491812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f2da1-5586-407d-b291-2dbeb741aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.492220 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f2da1-5586-407d-b291-2dbeb741aed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.492918 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f2da1-5586-407d-b291-2dbeb741aed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.495234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f2da1-5586-407d-b291-2dbeb741aed4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.518975 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1160/2312] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:38 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:38.522016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f2da1-5586-407d-b291-2dbeb741aed4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.533592 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f2da1-5586-407d-b291-2dbeb741aed4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.538384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf2831-e6d6-4d46-aa4c-eaf2fec25f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.539333 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf2831-e6d6-4d46-aa4c-eaf2fec25f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.539446 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538afe18-d054-4d51-99ff-6a4cbb473ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.539858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf2831-e6d6-4d46-aa4c-eaf2fec25f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.540296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538afe18-d054-4d51-99ff-6a4cbb473ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.540402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf2831-e6d6-4d46-aa4c-eaf2fec25f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.540641 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538afe18-d054-4d51-99ff-6a4cbb473ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.540983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538afe18-d054-4d51-99ff-6a4cbb473ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.541156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf2831-e6d6-4d46-aa4c-eaf2fec25f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.541782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538afe18-d054-4d51-99ff-6a4cbb473ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.542913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf2831-e6d6-4d46-aa4c-eaf2fec25f17 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.544391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538afe18-d054-4d51-99ff-6a4cbb473ea6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.554570 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1161/2313] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:38.559548 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf2831-e6d6-4d46-aa4c-eaf2fec25f17 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.567828 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1153/2314] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:38 2022] POST /identity/v3/users => generated 309 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:38.571648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf2831-e6d6-4d46-aa4c-eaf2fec25f17 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.571792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538afe18-d054-4d51-99ff-6a4cbb473ea6 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.576961 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a43c-8dde-406c-98b9-24eaa81d62d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.577673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a43c-8dde-406c-98b9-24eaa81d62d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.577946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a43c-8dde-406c-98b9-24eaa81d62d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.578811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a43c-8dde-406c-98b9-24eaa81d62d5 admin admin] PATH_INFO: `/v3/projects/22ba9519dcc541548b2878aaa621752e/users/56ce7c869ed64dffa6190240e4a06571/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.582832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538afe18-d054-4d51-99ff-6a4cbb473ea6 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.587525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723c33a-3a2f-4af3-bd3b-76bacdd1aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.588124 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723c33a-3a2f-4af3-bd3b-76bacdd1aef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.588404 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723c33a-3a2f-4af3-bd3b-76bacdd1aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.588679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723c33a-3a2f-4af3-bd3b-76bacdd1aef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.589327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723c33a-3a2f-4af3-bd3b-76bacdd1aef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.591578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723c33a-3a2f-4af3-bd3b-76bacdd1aef9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.594491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490a43c-8dde-406c-98b9-24eaa81d62d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ba9519dcc541548b2878aaa621752e, user_id=56ce7c869ed64dffa6190240e4a06571, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.597179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490a43c-8dde-406c-98b9-24eaa81d62d5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.605449 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1154/2315] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:38.611342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723c33a-3a2f-4af3-bd3b-76bacdd1aef9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.622692 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1162/2316] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:38 2022] PUT /identity/v3/projects/22ba9519dcc541548b2878aaa621752e/users/56ce7c869ed64dffa6190240e4a06571/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:38.624483 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723c33a-3a2f-4af3-bd3b-76bacdd1aef9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.626663 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a43c-8dde-406c-98b9-24eaa81d62d5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.645801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:38.702634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa0fc-b601-434f-b045-45d74ecbf6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.703433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa0fc-b601-434f-b045-45d74ecbf6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.703794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa0fc-b601-434f-b045-45d74ecbf6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.704612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa0fc-b601-434f-b045-45d74ecbf6b1 admin admin] PATH_INFO: `/v3/projects/2cfb23c039084cb3bb7dae5b5c7553f7/users/98004a468c294e7795c7b8036da38cec/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.730051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84aa0fc-b601-434f-b045-45d74ecbf6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfb23c039084cb3bb7dae5b5c7553f7, user_id=98004a468c294e7795c7b8036da38cec, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.731071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a43c-8dde-406c-98b9-24eaa81d62d5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.733496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84aa0fc-b601-434f-b045-45d74ecbf6b1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.736499 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a85ec-7eec-493a-940d-593b4cefa3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.737116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a85ec-7eec-493a-940d-593b4cefa3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.737398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a85ec-7eec-493a-940d-593b4cefa3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.737763 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a85ec-7eec-493a-940d-593b4cefa3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.738629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a85ec-7eec-493a-940d-593b4cefa3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.740503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a85ec-7eec-493a-940d-593b4cefa3b2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.753194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1155/2317] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:38 2022] PUT /identity/v3/projects/2cfb23c039084cb3bb7dae5b5c7553f7/users/98004a468c294e7795c7b8036da38cec/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:38.753462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1163/2318] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:38.757778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa0fc-b601-434f-b045-45d74ecbf6b1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.759451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a85ec-7eec-493a-940d-593b4cefa3b2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.772967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a85ec-7eec-493a-940d-593b4cefa3b2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.814850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:38.845792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa0fc-b601-434f-b045-45d74ecbf6b1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.851399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d06a4-4ff4-4206-95e3-8155090732cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.851620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ee7a-454b-4e77-aab6-6d70b3c20817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.853267 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ee7a-454b-4e77-aab6-6d70b3c20817 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.853397 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d06a4-4ff4-4206-95e3-8155090732cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.853507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ee7a-454b-4e77-aab6-6d70b3c20817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.853608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d06a4-4ff4-4206-95e3-8155090732cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.853707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ee7a-454b-4e77-aab6-6d70b3c20817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.853805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d06a4-4ff4-4206-95e3-8155090732cb admin admin] PATH_INFO: `/v3/projects/22ba9519dcc541548b2878aaa621752e/users/56ce7c869ed64dffa6190240e4a06571/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.853908 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6ee7a-454b-4e77-aab6-6d70b3c20817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.855184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6ee7a-454b-4e77-aab6-6d70b3c20817 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.855835 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d06a4-4ff4-4206-95e3-8155090732cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ba9519dcc541548b2878aaa621752e, user_id=56ce7c869ed64dffa6190240e4a06571, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.858823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d06a4-4ff4-4206-95e3-8155090732cb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.866774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1156/2319] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:38.871177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ee7a-454b-4e77-aab6-6d70b3c20817 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:38.875338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1164/2320] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:38 2022] PUT /identity/v3/projects/22ba9519dcc541548b2878aaa621752e/users/56ce7c869ed64dffa6190240e4a06571/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:38.890885 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff5ab-16e3-4a3a-8aa5-9eea4ff63b6f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.891433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff5ab-16e3-4a3a-8aa5-9eea4ff63b6f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.891876 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff5ab-16e3-4a3a-8aa5-9eea4ff63b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.892722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ee7a-454b-4e77-aab6-6d70b3c20817 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:38.948566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ff0ff5ab-16e3-4a3a-8aa5-9eea4ff63b6f None None] MFA Rules not processed for user `56ce7c869ed64dffa6190240e4a06571`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:38.950589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ff0ff5ab-16e3-4a3a-8aa5-9eea4ff63b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:38.980659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812df3a1-6925-4bcb-a395-6fa21923baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:38.981747 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812df3a1-6925-4bcb-a395-6fa21923baa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:38.982101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812df3a1-6925-4bcb-a395-6fa21923baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:38.982426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812df3a1-6925-4bcb-a395-6fa21923baa5 admin admin] PATH_INFO: `/v3/projects/2cfb23c039084cb3bb7dae5b5c7553f7/users/98004a468c294e7795c7b8036da38cec/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:38.984886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812df3a1-6925-4bcb-a395-6fa21923baa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfb23c039084cb3bb7dae5b5c7553f7, user_id=98004a468c294e7795c7b8036da38cec, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:38.988096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812df3a1-6925-4bcb-a395-6fa21923baa5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:38.999976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1157/2321] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:38 2022] PUT /identity/v3/projects/2cfb23c039084cb3bb7dae5b5c7553f7/users/98004a468c294e7795c7b8036da38cec/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:39.012537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edde3f-fc7d-4718-b439-ae424ee66a83 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:39.012833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edde3f-fc7d-4718-b439-ae424ee66a83 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:39.013240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edde3f-fc7d-4718-b439-ae424ee66a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:39.037639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1165/2322] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:39.043829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c2edde3f-fc7d-4718-b439-ae424ee66a83 None None] MFA Rules not processed for user `98004a468c294e7795c7b8036da38cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:39.045090 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c2edde3f-fc7d-4718-b439-ae424ee66a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:39.050971 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff5ab-16e3-4a3a-8aa5-9eea4ff63b6f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:39.079540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:39.111986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff5ab-16e3-4a3a-8aa5-9eea4ff63b6f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:39.118094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1158/2323] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:39 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:39.129642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edde3f-fc7d-4718-b439-ae424ee66a83 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:39.131164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c2edde3f-fc7d-4718-b439-ae424ee66a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:39.164046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d621b4b-1a20-404b-a5d3-74fd2cc7bc4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:39.164653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621b4b-1a20-404b-a5d3-74fd2cc7bc4c service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:39.164932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621b4b-1a20-404b-a5d3-74fd2cc7bc4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:39.165204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621b4b-1a20-404b-a5d3-74fd2cc7bc4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:39.190108 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edde3f-fc7d-4718-b439-ae424ee66a83 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:39.193883 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318f617-f119-45c4-9900-94673dcc733d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:39.194582 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f617-f119-45c4-9900-94673dcc733d service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:39.194820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f617-f119-45c4-9900-94673dcc733d service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:39.195094 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f617-f119-45c4-9900-94673dcc733d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:39.204974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318f617-f119-45c4-9900-94673dcc733d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:39.206411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318f617-f119-45c4-9900-94673dcc733d service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:39.210322 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:39.218330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1159/2324] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:39 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:39.226618 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d621b4b-1a20-404b-a5d3-74fd2cc7bc4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:39.228082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d621b4b-1a20-404b-a5d3-74fd2cc7bc4c service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:39.237686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1166/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:39.410531 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318f617-f119-45c4-9900-94673dcc733d service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:39.497316 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318f617-f119-45c4-9900-94673dcc733d service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:39.504759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:39.504759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:39.504759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:39.504759 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] PATH_INFO: `/v3/users/cc031becf534427ba70390543a2f4096` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:39.505144 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc031becf534427ba70390543a2f4096)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:39.506928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:39.575052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc031becf534427ba70390543a2f4096'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:39.587964 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc031becf534427ba70390543a2f4096'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:39.595163 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc031becf534427ba70390543a2f4096'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:39.595966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc031becf534427ba70390543a2f4096'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:39.605339 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc031becf534427ba70390543a2f4096'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:39.617189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1160/2326] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:39 2022] DELETE /identity/v3/users/cc031becf534427ba70390543a2f4096 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:39.618758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6f3eb-45bb-4b4c-9a9d-df2e12cd0fcb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:39.619049 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6f3eb-45bb-4b4c-9a9d-df2e12cd0fcb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:39.619326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6f3eb-45bb-4b4c-9a9d-df2e12cd0fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:39.641375 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-00e6f3eb-45bb-4b4c-9a9d-df2e12cd0fcb None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:39.642690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-00e6f3eb-45bb-4b4c-9a9d-df2e12cd0fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:39.724167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1167/2327] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:39.734799 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:39.736596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:39.802960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c006a-e91e-4f0e-b53e-09b522ca3cef admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:39.806887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:39.807499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:39.807776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:39.808048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:39.818646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:39.820079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:39.830615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1161/2328] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:40.002190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6f3eb-45bb-4b4c-9a9d-df2e12cd0fcb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:40.017670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6f3eb-45bb-4b4c-9a9d-df2e12cd0fcb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:40.024331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:40.025346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:40.025722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:40.026241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:40.028456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:40.041953 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:40.043610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:40.053850 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1168/2329] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:40.147502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:40.148971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:40.177687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f340a82-ba80-4740-ab8b-987d9927c404 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:40.184844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:40.185514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:40.185811 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:40.186071 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] PATH_INFO: `/v3/projects/f32f3fc671d04e01b87124f07a758b06` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:40.187480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32f3fc671d04e01b87124f07a758b06)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:40.189528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:40.207117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:40.241496 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32f3fc671d04e01b87124f07a758b06', 'request_id': 'req-19b82062-e63a-4700-a0bd-7c656fda30a1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.248638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32f3fc671d04e01b87124f07a758b06', 'request_id': 'req-19b82062-e63a-4700-a0bd-7c656fda30a1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.254687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32f3fc671d04e01b87124f07a758b06', 'request_id': 'req-19b82062-e63a-4700-a0bd-7c656fda30a1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.267561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] The token cache is being invalidate because project f32f3fc671d04e01b87124f07a758b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:40.267855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.268478 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.269971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1162/2330] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:40 2022] DELETE /identity/v3/projects/f32f3fc671d04e01b87124f07a758b06 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:40.274016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:40.284035 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d375c2-4e84-473b-ba13-d5c6e105ea84 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:40.303804 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:40.345462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:40.346102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:40.346416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:40.346727 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] PATH_INFO: `/v3/users/98004a468c294e7795c7b8036da38cec` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:40.347886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98004a468c294e7795c7b8036da38cec)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:40.349969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:40.401591 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98004a468c294e7795c7b8036da38cec'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.402193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98004a468c294e7795c7b8036da38cec'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.409332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98004a468c294e7795c7b8036da38cec'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.422947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98004a468c294e7795c7b8036da38cec'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.423648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8b3f8073-98b5-4a6e-ba79-580bbac13168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98004a468c294e7795c7b8036da38cec'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:40.437667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1169/2331] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:40 2022] DELETE /identity/v3/users/98004a468c294e7795c7b8036da38cec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:41.243669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:41.245286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:41.274379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82062-e63a-4700-a0bd-7c656fda30a1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:41.336100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:41.336766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.337044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.337341 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] PATH_INFO: `/v3/projects/2cfb23c039084cb3bb7dae5b5c7553f7` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.338447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfb23c039084cb3bb7dae5b5c7553f7)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:41.340948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:41.390737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfb23c039084cb3bb7dae5b5c7553f7', 'request_id': 'req-cd9d82c8-838d-4318-844c-26e203b2af53'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:41.397282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfb23c039084cb3bb7dae5b5c7553f7', 'request_id': 'req-cd9d82c8-838d-4318-844c-26e203b2af53'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:41.403084 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfb23c039084cb3bb7dae5b5c7553f7', 'request_id': 'req-cd9d82c8-838d-4318-844c-26e203b2af53'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:41.420972 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] The token cache is being invalidate because project 2cfb23c039084cb3bb7dae5b5c7553f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:41.421353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:41.422309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd9d82c8-838d-4318-844c-26e203b2af53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:41.424386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1163/2332] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:41 2022] DELETE /identity/v3/projects/2cfb23c039084cb3bb7dae5b5c7553f7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:41.429113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dda3f-706f-4c17-b3ec-5bb6d2dfac8a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.429615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dda3f-706f-4c17-b3ec-5bb6d2dfac8a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.429712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dda3f-706f-4c17-b3ec-5bb6d2dfac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.455864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5f4dda3f-706f-4c17-b3ec-5bb6d2dfac8a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:41.457084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5f4dda3f-706f-4c17-b3ec-5bb6d2dfac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:41.535255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1170/2333] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:41.538452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea410f-a017-4e9f-b2ac-d0d5c135bbdd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.538834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea410f-a017-4e9f-b2ac-d0d5c135bbdd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.539056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea410f-a017-4e9f-b2ac-d0d5c135bbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.559983 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-29ea410f-a017-4e9f-b2ac-d0d5c135bbdd None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:41.561198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-29ea410f-a017-4e9f-b2ac-d0d5c135bbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:41.573529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1164/2334] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:41.575465 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dda3f-706f-4c17-b3ec-5bb6d2dfac8a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:41.586406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dda3f-706f-4c17-b3ec-5bb6d2dfac8a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:41.591843 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:41.592518 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.592801 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.593071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.593739 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:41.594039 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:41.595659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:41.612472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1171/2335] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:41.617690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea410f-a017-4e9f-b2ac-d0d5c135bbdd None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:41.629676 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea410f-a017-4e9f-b2ac-d0d5c135bbdd None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:41.634389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c14d14-3b82-4f1c-b9ff-0f50757fcbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:41.635043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c14d14-3b82-4f1c-b9ff-0f50757fcbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.635327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c14d14-3b82-4f1c-b9ff-0f50757fcbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.635603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c14d14-3b82-4f1c-b9ff-0f50757fcbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.636234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c14d14-3b82-4f1c-b9ff-0f50757fcbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:41.638250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c14d14-3b82-4f1c-b9ff-0f50757fcbf8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:41.666668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1165/2336] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:41 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:41.670846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:41.682474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d653db9-82af-45ab-ba37-4795bbae2b54 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:41.709543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:41.743564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11a3d-54e6-4f55-9ac7-cab0a4c6ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:41.744169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11a3d-54e6-4f55-9ac7-cab0a4c6ca8c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.744452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11a3d-54e6-4f55-9ac7-cab0a4c6ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.744729 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11a3d-54e6-4f55-9ac7-cab0a4c6ca8c admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.745374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b11a3d-54e6-4f55-9ac7-cab0a4c6ca8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:41.747866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b11a3d-54e6-4f55-9ac7-cab0a4c6ca8c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:41.770167 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1172/2337] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:41 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:41.774175 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c14d14-3b82-4f1c-b9ff-0f50757fcbf8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:41.780831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:41.785372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c14d14-3b82-4f1c-b9ff-0f50757fcbf8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:41.797797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984a9f0-9634-4a46-b215-127c23e3bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:41.798420 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984a9f0-9634-4a46-b215-127c23e3bc06 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.799006 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984a9f0-9634-4a46-b215-127c23e3bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.799480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984a9f0-9634-4a46-b215-127c23e3bc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.800185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984a9f0-9634-4a46-b215-127c23e3bc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:41.801945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984a9f0-9634-4a46-b215-127c23e3bc06 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:41.814602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1166/2338] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:41.818625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11a3d-54e6-4f55-9ac7-cab0a4c6ca8c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:41.829181 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11a3d-54e6-4f55-9ac7-cab0a4c6ca8c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:41.834038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e619e-bc13-4057-bcd2-7a8c956fb89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:41.834669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e619e-bc13-4057-bcd2-7a8c956fb89a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.834948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e619e-bc13-4057-bcd2-7a8c956fb89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.835218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e619e-bc13-4057-bcd2-7a8c956fb89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.835870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e619e-bc13-4057-bcd2-7a8c956fb89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:41.837613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e619e-bc13-4057-bcd2-7a8c956fb89a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:41.850231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1173/2339] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:41.854207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984a9f0-9634-4a46-b215-127c23e3bc06 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:41.866443 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984a9f0-9634-4a46-b215-127c23e3bc06 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:41.871374 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f875f7c-31a5-4042-8cda-3e52d04f903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:41.872107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f875f7c-31a5-4042-8cda-3e52d04f903c admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.872482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f875f7c-31a5-4042-8cda-3e52d04f903c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.872906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f875f7c-31a5-4042-8cda-3e52d04f903c admin admin] PATH_INFO: `/v3/projects/cbd8e4ddfe4e4314b6f2e4c397975f0a/users/938e8bac374b43d392fcaddbfd46b827/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.900329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f875f7c-31a5-4042-8cda-3e52d04f903c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd8e4ddfe4e4314b6f2e4c397975f0a, user_id=938e8bac374b43d392fcaddbfd46b827, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:41.903745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f875f7c-31a5-4042-8cda-3e52d04f903c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:41.918384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1167/2340] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:41 2022] PUT /identity/v3/projects/cbd8e4ddfe4e4314b6f2e4c397975f0a/users/938e8bac374b43d392fcaddbfd46b827/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:41.928453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206a8f-60d2-49ec-aa5c-5b20cc273837 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:41.928735 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206a8f-60d2-49ec-aa5c-5b20cc273837 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:41.929009 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206a8f-60d2-49ec-aa5c-5b20cc273837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:41.963950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b8206a8f-60d2-49ec-aa5c-5b20cc273837 None None] MFA Rules not processed for user `938e8bac374b43d392fcaddbfd46b827`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:41.965256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b8206a8f-60d2-49ec-aa5c-5b20cc273837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:42.053287 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1174/2341] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:42.057352 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f875f7c-31a5-4042-8cda-3e52d04f903c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:42.128309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f875f7c-31a5-4042-8cda-3e52d04f903c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:42.133357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c5a2d-fe84-4c86-ad80-c4408cc12de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:42.133961 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c5a2d-fe84-4c86-ad80-c4408cc12de8 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:42.134238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c5a2d-fe84-4c86-ad80-c4408cc12de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:42.134509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c5a2d-fe84-4c86-ad80-c4408cc12de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:42.135184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c5a2d-fe84-4c86-ad80-c4408cc12de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:42.137476 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c5a2d-fe84-4c86-ad80-c4408cc12de8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:42.169659 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1168/2342] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:42 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:42.173391 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206a8f-60d2-49ec-aa5c-5b20cc273837 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:42.185608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206a8f-60d2-49ec-aa5c-5b20cc273837 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:42.274963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f91e2-8a4a-477c-8818-7831294d3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:42.275491 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f91e2-8a4a-477c-8818-7831294d3d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:42.275869 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f91e2-8a4a-477c-8818-7831294d3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:42.276152 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f91e2-8a4a-477c-8818-7831294d3d33 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:42.276800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f91e2-8a4a-477c-8818-7831294d3d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:42.278946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f91e2-8a4a-477c-8818-7831294d3d33 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:42.327314 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1175/2343] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:42 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:42.330945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c5a2d-fe84-4c86-ad80-c4408cc12de8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:42.349445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c5a2d-fe84-4c86-ad80-c4408cc12de8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:42.361023 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399b91f-6035-4664-8f56-c976d64d466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:42.361810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399b91f-6035-4664-8f56-c976d64d466c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:42.362315 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399b91f-6035-4664-8f56-c976d64d466c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:42.363031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399b91f-6035-4664-8f56-c976d64d466c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:42.364099 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399b91f-6035-4664-8f56-c976d64d466c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:42.365980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399b91f-6035-4664-8f56-c976d64d466c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:42.405189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1169/2344] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:42.409497 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f91e2-8a4a-477c-8818-7831294d3d33 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:42.423648 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f91e2-8a4a-477c-8818-7831294d3d33 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:42.430579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e044684-3316-4143-ad8d-b13d03c6276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:42.431956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044684-3316-4143-ad8d-b13d03c6276e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:42.432269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044684-3316-4143-ad8d-b13d03c6276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:42.432579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044684-3316-4143-ad8d-b13d03c6276e admin admin] PATH_INFO: `/v3/projects/5fb616de8565411587f26ed03e1714e9/users/0ae0d80a290147489e7f470671ce4a2d/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:42.457472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e044684-3316-4143-ad8d-b13d03c6276e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb616de8565411587f26ed03e1714e9, user_id=0ae0d80a290147489e7f470671ce4a2d, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:42.460371 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e044684-3316-4143-ad8d-b13d03c6276e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:42.478215 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1176/2345] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:42 2022] PUT /identity/v3/projects/5fb616de8565411587f26ed03e1714e9/users/0ae0d80a290147489e7f470671ce4a2d/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:42.483774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399b91f-6035-4664-8f56-c976d64d466c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:42.501472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399b91f-6035-4664-8f56-c976d64d466c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:42.586668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c2fda-9007-4fa2-81e1-86aa5aa7edbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:42.587008 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2fda-9007-4fa2-81e1-86aa5aa7edbb admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:42.587335 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2fda-9007-4fa2-81e1-86aa5aa7edbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:42.587693 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2fda-9007-4fa2-81e1-86aa5aa7edbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:42.588681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c2fda-9007-4fa2-81e1-86aa5aa7edbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:42.590858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c2fda-9007-4fa2-81e1-86aa5aa7edbb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:42.602922 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1170/2346] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:42.608563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e044684-3316-4143-ad8d-b13d03c6276e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:42.615674 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:42.623451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e044684-3316-4143-ad8d-b13d03c6276e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:42.631480 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:42.632393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:42.632937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:42.633392 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] PATH_INFO: `/v3/projects/5fb616de8565411587f26ed03e1714e9/users/0ae0d80a290147489e7f470671ce4a2d/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:42.636017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb616de8565411587f26ed03e1714e9, user_id=0ae0d80a290147489e7f470671ce4a2d, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:42.638989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:42.651406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1177/2347] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:42 2022] PUT /identity/v3/projects/5fb616de8565411587f26ed03e1714e9/users/0ae0d80a290147489e7f470671ce4a2d/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:42.663517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75fc32-d8ee-4bf5-beb8-c035f719fb16 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:42.663915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75fc32-d8ee-4bf5-beb8-c035f719fb16 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:42.664274 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75fc32-d8ee-4bf5-beb8-c035f719fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:42.704976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2c75fc32-d8ee-4bf5-beb8-c035f719fb16 None None] MFA Rules not processed for user `0ae0d80a290147489e7f470671ce4a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:42.706313 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2c75fc32-d8ee-4bf5-beb8-c035f719fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:42.745719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:42.792647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1171/2348] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:42.805289 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:42.807127 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:42.868274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d01e8-1497-4f68-bc17-ccbc083401b1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:42.872402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a4edc-c232-4e86-9a39-d5050c1b4773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:42.873004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a4edc-c232-4e86-9a39-d5050c1b4773 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:42.873279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a4edc-c232-4e86-9a39-d5050c1b4773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:42.873550 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a4edc-c232-4e86-9a39-d5050c1b4773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:42.888074 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a4edc-c232-4e86-9a39-d5050c1b4773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:42.894354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a4edc-c232-4e86-9a39-d5050c1b4773 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:42.901249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1178/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:42.990955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75fc32-d8ee-4bf5-beb8-c035f719fb16 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:43.074633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75fc32-d8ee-4bf5-beb8-c035f719fb16 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:43.080028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:43.080777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:43.081319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:43.081319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] PATH_INFO: `/v3/users/938e8bac374b43d392fcaddbfd46b827` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:43.082482 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=938e8bac374b43d392fcaddbfd46b827)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:43.092282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:43.158776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938e8bac374b43d392fcaddbfd46b827'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:43.185066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938e8bac374b43d392fcaddbfd46b827'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:43.195506 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938e8bac374b43d392fcaddbfd46b827'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:43.197491 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938e8bac374b43d392fcaddbfd46b827'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:43.207518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938e8bac374b43d392fcaddbfd46b827'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:43.219115 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1172/2350] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:42 2022] DELETE /identity/v3/users/938e8bac374b43d392fcaddbfd46b827 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:43.223793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6f6a-00b4-44b4-962c-71b17e04d499 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:43.224143 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6f6a-00b4-44b4-962c-71b17e04d499 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:43.224425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6f6a-00b4-44b4-962c-71b17e04d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:43.250712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e8ea6f6a-00b4-44b4-962c-71b17e04d499 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:43.252071 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e8ea6f6a-00b4-44b4-962c-71b17e04d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:43.340473 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1179/2351] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:43.353135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:43.355923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:43.447027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:43.468718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2912d-f2c3-406f-8e4c-11243c7d8dba admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:43.475723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:43.477064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:43.478357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:43.478666 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:43.495542 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:43.497515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:43.523032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1173/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:43.884825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6f6a-00b4-44b4-962c-71b17e04d499 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:43.891546 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e8ea6f6a-00b4-44b4-962c-71b17e04d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:43.959540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6f6a-00b4-44b4-962c-71b17e04d499 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:43.963593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:43.964204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:43.965225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:43.965639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:43.967842 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:44.024899 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:44.047904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:44.048369 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:44.049482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:44.050185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:44.062248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1180/2353] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:44.066114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b596c-8d31-461c-82d2-aa8f4f68a823 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:44.072638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:44.073276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:44.073558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:44.073836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] PATH_INFO: `/v3/projects/cbd8e4ddfe4e4314b6f2e4c397975f0a` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:44.075118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd8e4ddfe4e4314b6f2e4c397975f0a)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:44.077194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:44.143432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd8e4ddfe4e4314b6f2e4c397975f0a', 'request_id': 'req-505b91de-b093-467a-bb5f-49aec3b6647e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.150160 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd8e4ddfe4e4314b6f2e4c397975f0a', 'request_id': 'req-505b91de-b093-467a-bb5f-49aec3b6647e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.156187 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd8e4ddfe4e4314b6f2e4c397975f0a', 'request_id': 'req-505b91de-b093-467a-bb5f-49aec3b6647e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.170328 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] The token cache is being invalidate because project cbd8e4ddfe4e4314b6f2e4c397975f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:44.170758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.171450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.173410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1174/2354] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:44 2022] DELETE /identity/v3/projects/cbd8e4ddfe4e4314b6f2e4c397975f0a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:44.177292 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:44.190131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4fe76-375b-4684-9d85-298f1c7fb333 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:44.268188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:44.268812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:44.269091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:44.269363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] PATH_INFO: `/v3/users/0ae0d80a290147489e7f470671ce4a2d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:44.270584 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae0d80a290147489e7f470671ce4a2d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:44.272493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:44.339235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae0d80a290147489e7f470671ce4a2d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.340605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae0d80a290147489e7f470671ce4a2d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.355356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae0d80a290147489e7f470671ce4a2d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.377070 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae0d80a290147489e7f470671ce4a2d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.378101 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-45a8c62e-9f5a-4e7b-846c-7b95cc722954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae0d80a290147489e7f470671ce4a2d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.410080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1181/2355] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:44 2022] DELETE /identity/v3/users/0ae0d80a290147489e7f470671ce4a2d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:44.718415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:44.720039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:44.739078 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b91de-b093-467a-bb5f-49aec3b6647e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:44.800110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:44.800778 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:44.801059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:44.801334 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] PATH_INFO: `/v3/projects/5fb616de8565411587f26ed03e1714e9` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:44.802647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb616de8565411587f26ed03e1714e9)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:44.804633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:44.852293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb616de8565411587f26ed03e1714e9', 'request_id': 'req-42d8729f-2d61-4790-98d0-a7007610a60a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.859699 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb616de8565411587f26ed03e1714e9', 'request_id': 'req-42d8729f-2d61-4790-98d0-a7007610a60a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.865498 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb616de8565411587f26ed03e1714e9', 'request_id': 'req-42d8729f-2d61-4790-98d0-a7007610a60a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.876246 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:44.884518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] The token cache is being invalidate because project 5fb616de8565411587f26ed03e1714e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:44.885336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.887608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-42d8729f-2d61-4790-98d0-a7007610a60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:44.893181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1175/2356] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:44 2022] DELETE /identity/v3/projects/5fb616de8565411587f26ed03e1714e9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:44.895508 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96184d-6300-4782-8737-4e273a04c0f1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:44.896345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96184d-6300-4782-8737-4e273a04c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:44.896848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96184d-6300-4782-8737-4e273a04c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:44.917785 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6e96184d-6300-4782-8737-4e273a04c0f1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:44.919033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6e96184d-6300-4782-8737-4e273a04c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:44.987656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1182/2357] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:44.995667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2d142-1121-40b7-8c2f-1bc835f112b1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:44.996589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2d142-1121-40b7-8c2f-1bc835f112b1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:44.996870 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2d142-1121-40b7-8c2f-1bc835f112b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.021392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6ba2d142-1121-40b7-8c2f-1bc835f112b1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:45.022319 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6ba2d142-1121-40b7-8c2f-1bc835f112b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:45.035135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1176/2358] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:45.036894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96184d-6300-4782-8737-4e273a04c0f1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.043219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:45.051806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96184d-6300-4782-8737-4e273a04c0f1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.060632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.062888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.064051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.064342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.065238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:45.065702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.067511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.082982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1183/2359] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:45.088872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2d142-1121-40b7-8c2f-1bc835f112b1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.102129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2d142-1121-40b7-8c2f-1bc835f112b1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.107989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4a342-2015-4343-a00e-5123bfc8e0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.108709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4a342-2015-4343-a00e-5123bfc8e0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.109054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4a342-2015-4343-a00e-5123bfc8e0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.109399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4a342-2015-4343-a00e-5123bfc8e0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.110731 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4a342-2015-4343-a00e-5123bfc8e0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.112704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4a342-2015-4343-a00e-5123bfc8e0cc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.156753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1177/2360] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:45 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:45.160847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.172385 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abc9d-c1f1-46c4-8d50-98382dfc6087 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.244775 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f993d-e8b8-42bb-a3e8-422075f77d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.245383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f993d-e8b8-42bb-a3e8-422075f77d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.245658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f993d-e8b8-42bb-a3e8-422075f77d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.246484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f993d-e8b8-42bb-a3e8-422075f77d47 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.247178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f993d-e8b8-42bb-a3e8-422075f77d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.249110 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f993d-e8b8-42bb-a3e8-422075f77d47 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.271995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1184/2361] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:45 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:45.276060 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4a342-2015-4343-a00e-5123bfc8e0cc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.286294 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4a342-2015-4343-a00e-5123bfc8e0cc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.290852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23f5eb-b8b0-409b-9c47-e61a76f5c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.291448 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23f5eb-b8b0-409b-9c47-e61a76f5c14f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.291726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23f5eb-b8b0-409b-9c47-e61a76f5c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.291993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23f5eb-b8b0-409b-9c47-e61a76f5c14f admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.292667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23f5eb-b8b0-409b-9c47-e61a76f5c14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.294455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23f5eb-b8b0-409b-9c47-e61a76f5c14f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.305152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1178/2362] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:45.309908 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f993d-e8b8-42bb-a3e8-422075f77d47 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.320948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f993d-e8b8-42bb-a3e8-422075f77d47 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.325934 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33a039-3d59-43c7-a816-f1b8b0c9ef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.326686 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33a039-3d59-43c7-a816-f1b8b0c9ef66 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.326967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33a039-3d59-43c7-a816-f1b8b0c9ef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.327242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33a039-3d59-43c7-a816-f1b8b0c9ef66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.327886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33a039-3d59-43c7-a816-f1b8b0c9ef66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.329506 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33a039-3d59-43c7-a816-f1b8b0c9ef66 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.340867 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1185/2363] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:45.344924 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23f5eb-b8b0-409b-9c47-e61a76f5c14f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.355960 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23f5eb-b8b0-409b-9c47-e61a76f5c14f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.361302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c068-25ca-4210-9cca-868081f5d057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.362012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c068-25ca-4210-9cca-868081f5d057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.362353 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c068-25ca-4210-9cca-868081f5d057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.362744 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c068-25ca-4210-9cca-868081f5d057 admin admin] PATH_INFO: `/v3/projects/e795ffc4ee5b4dbe911f2bcf23ebae0e/users/5f06dd9851704fa183d2b9056e26f931/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.377317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1c068-25ca-4210-9cca-868081f5d057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e795ffc4ee5b4dbe911f2bcf23ebae0e, user_id=5f06dd9851704fa183d2b9056e26f931, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.380078 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1c068-25ca-4210-9cca-868081f5d057 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.394059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1179/2364] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:45 2022] PUT /identity/v3/projects/e795ffc4ee5b4dbe911f2bcf23ebae0e/users/5f06dd9851704fa183d2b9056e26f931/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:45.404370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21310-84b6-4bd4-bc36-7b76f2f42045 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.404662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21310-84b6-4bd4-bc36-7b76f2f42045 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.404935 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21310-84b6-4bd4-bc36-7b76f2f42045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.442246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-49e21310-84b6-4bd4-bc36-7b76f2f42045 None None] MFA Rules not processed for user `5f06dd9851704fa183d2b9056e26f931`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:45.443815 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-49e21310-84b6-4bd4-bc36-7b76f2f42045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:45.517539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1186/2365] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:45.521937 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c068-25ca-4210-9cca-868081f5d057 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.629690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c068-25ca-4210-9cca-868081f5d057 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.636967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fbc88-5ee8-4149-b240-b9d59473ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.637629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbc88-5ee8-4149-b240-b9d59473ae4d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.637936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbc88-5ee8-4149-b240-b9d59473ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.638236 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbc88-5ee8-4149-b240-b9d59473ae4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.638888 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fbc88-5ee8-4149-b240-b9d59473ae4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.640945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fbc88-5ee8-4149-b240-b9d59473ae4d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.681129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1180/2366] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:45 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:45.686170 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e21310-84b6-4bd4-bc36-7b76f2f42045 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.703431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e21310-84b6-4bd4-bc36-7b76f2f42045 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.814948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:45.825239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defbc64-8c05-4849-9743-4f1e924caac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.825882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defbc64-8c05-4849-9743-4f1e924caac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.826162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defbc64-8c05-4849-9743-4f1e924caac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.826454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defbc64-8c05-4849-9743-4f1e924caac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.829580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defbc64-8c05-4849-9743-4f1e924caac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.841754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defbc64-8c05-4849-9743-4f1e924caac8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.877354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1187/2367] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:45 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:45.881459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fbc88-5ee8-4149-b240-b9d59473ae4d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.899121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fbc88-5ee8-4149-b240-b9d59473ae4d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.910559 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbf75e-26bc-467f-960e-2e101c5d3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.911191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbf75e-26bc-467f-960e-2e101c5d3017 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.911472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbf75e-26bc-467f-960e-2e101c5d3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.911745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbf75e-26bc-467f-960e-2e101c5d3017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.914327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbf75e-26bc-467f-960e-2e101c5d3017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.919441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbf75e-26bc-467f-960e-2e101c5d3017 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:45.945001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1181/2368] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:45.945307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defbc64-8c05-4849-9743-4f1e924caac8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:45.962416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defbc64-8c05-4849-9743-4f1e924caac8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:45.970793 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657993db-9d50-4378-b340-fef27fe22441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:45.971750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657993db-9d50-4378-b340-fef27fe22441 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:45.972132 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657993db-9d50-4378-b340-fef27fe22441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:45.972675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657993db-9d50-4378-b340-fef27fe22441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:45.973588 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657993db-9d50-4378-b340-fef27fe22441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:45.976578 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657993db-9d50-4378-b340-fef27fe22441 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.000740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbf75e-26bc-467f-960e-2e101c5d3017 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:46.014753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1188/2369] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:46.019414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbf75e-26bc-467f-960e-2e101c5d3017 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:46.028184 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dfbe-750a-432e-ba9b-0ad418ffca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:46.028867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dfbe-750a-432e-ba9b-0ad418ffca85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.029635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dfbe-750a-432e-ba9b-0ad418ffca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.030590 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dfbe-750a-432e-ba9b-0ad418ffca85 admin admin] PATH_INFO: `/v3/projects/3c8e72b70a2c43e08fe8139a0ea27b1a/users/38673a2eb2c54ba5832b56625355b1ea/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.052438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311dfbe-750a-432e-ba9b-0ad418ffca85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8e72b70a2c43e08fe8139a0ea27b1a, user_id=38673a2eb2c54ba5832b56625355b1ea, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:46.055327 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311dfbe-750a-432e-ba9b-0ad418ffca85 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.075409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1182/2370] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:45 2022] PUT /identity/v3/projects/3c8e72b70a2c43e08fe8139a0ea27b1a/users/38673a2eb2c54ba5832b56625355b1ea/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:46.088773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59063b-f9de-4ab7-94ee-0a183c3178ff None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.088773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59063b-f9de-4ab7-94ee-0a183c3178ff None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.088773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59063b-f9de-4ab7-94ee-0a183c3178ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.126762 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fa59063b-f9de-4ab7-94ee-0a183c3178ff None None] MFA Rules not processed for user `38673a2eb2c54ba5832b56625355b1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:46.128726 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fa59063b-f9de-4ab7-94ee-0a183c3178ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:46.216073 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1189/2371] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:46.220527 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dfbe-750a-432e-ba9b-0ad418ffca85 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:46.275025 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:46.295761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dfbe-750a-432e-ba9b-0ad418ffca85 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:46.301931 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b81933-88d0-4b39-981d-e1722906e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:46.302417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81933-88d0-4b39-981d-e1722906e923 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.302803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81933-88d0-4b39-981d-e1722906e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.303145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81933-88d0-4b39-981d-e1722906e923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.304288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b81933-88d0-4b39-981d-e1722906e923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:46.305825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b81933-88d0-4b39-981d-e1722906e923 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.343139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1183/2372] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:46 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:46.347021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59063b-f9de-4ab7-94ee-0a183c3178ff None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:46.360091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59063b-f9de-4ab7-94ee-0a183c3178ff None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:46.435851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919ecac-01af-45d0-8dbc-7905b3a75a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:46.436819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ecac-01af-45d0-8dbc-7905b3a75a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.437335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ecac-01af-45d0-8dbc-7905b3a75a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.437612 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ecac-01af-45d0-8dbc-7905b3a75a21 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.438471 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919ecac-01af-45d0-8dbc-7905b3a75a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:46.440623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919ecac-01af-45d0-8dbc-7905b3a75a21 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.465351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1190/2373] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:46 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:46.466625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b81933-88d0-4b39-981d-e1722906e923 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:46.477057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b81933-88d0-4b39-981d-e1722906e923 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:46.482411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65bb45-c16a-4420-ac89-776b56e64b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:46.483106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65bb45-c16a-4420-ac89-776b56e64b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.483460 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65bb45-c16a-4420-ac89-776b56e64b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.483871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65bb45-c16a-4420-ac89-776b56e64b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.484586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65bb45-c16a-4420-ac89-776b56e64b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:46.486442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65bb45-c16a-4420-ac89-776b56e64b64 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.499239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1184/2374] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:46.503485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919ecac-01af-45d0-8dbc-7905b3a75a21 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:46.514008 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919ecac-01af-45d0-8dbc-7905b3a75a21 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:46.518772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69e036-56c5-4b2e-b32c-6df4321a82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:46.519425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69e036-56c5-4b2e-b32c-6df4321a82be admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.519711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69e036-56c5-4b2e-b32c-6df4321a82be admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.519997 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69e036-56c5-4b2e-b32c-6df4321a82be admin admin] PATH_INFO: `/v3/projects/65840fda10cc49e0a05095fbf43937bf/users/2befc98ab04544e8a9356a05dd8ed515/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.539077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69e036-56c5-4b2e-b32c-6df4321a82be admin admin] RBAC: Authorizing `identity:create_grant(project_id=65840fda10cc49e0a05095fbf43937bf, user_id=2befc98ab04544e8a9356a05dd8ed515, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:46.541825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69e036-56c5-4b2e-b32c-6df4321a82be admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.556901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1191/2375] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:46 2022] PUT /identity/v3/projects/65840fda10cc49e0a05095fbf43937bf/users/2befc98ab04544e8a9356a05dd8ed515/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:46.560919 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65bb45-c16a-4420-ac89-776b56e64b64 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:46.571382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65bb45-c16a-4420-ac89-776b56e64b64 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:46.632484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec791066-87fe-493a-a6ad-a171b9778a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:46.633097 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec791066-87fe-493a-a6ad-a171b9778a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.633377 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec791066-87fe-493a-a6ad-a171b9778a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.633653 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec791066-87fe-493a-a6ad-a171b9778a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.634294 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec791066-87fe-493a-a6ad-a171b9778a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:46.635943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec791066-87fe-493a-a6ad-a171b9778a88 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.645965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1185/2376] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:46.650255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69e036-56c5-4b2e-b32c-6df4321a82be admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:46.661148 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69e036-56c5-4b2e-b32c-6df4321a82be admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:46.666829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:46.667435 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.668332 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.668680 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] PATH_INFO: `/v3/projects/65840fda10cc49e0a05095fbf43937bf/users/2befc98ab04544e8a9356a05dd8ed515/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.670673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65840fda10cc49e0a05095fbf43937bf, user_id=2befc98ab04544e8a9356a05dd8ed515, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:46.673310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.684383 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1192/2377] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:46 2022] PUT /identity/v3/projects/65840fda10cc49e0a05095fbf43937bf/users/2befc98ab04544e8a9356a05dd8ed515/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:46.695032 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc33fa-c15e-405b-93e2-982ca4a3ad8e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.695402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc33fa-c15e-405b-93e2-982ca4a3ad8e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.695944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc33fa-c15e-405b-93e2-982ca4a3ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.728103 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-30dc33fa-c15e-405b-93e2-982ca4a3ad8e None None] MFA Rules not processed for user `2befc98ab04544e8a9356a05dd8ed515`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:46.729389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-30dc33fa-c15e-405b-93e2-982ca4a3ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:46.812631 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1186/2378] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:46.826158 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:46.828466 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:46.853226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:46.905254 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e501-0f2e-4d48-af50-d068e5ba6bb2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:46.909493 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:46.910126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:46.910407 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:46.910773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:46.927780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:46.929335 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:46.940303 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1193/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:47.693285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc33fa-c15e-405b-93e2-982ca4a3ad8e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:47.704440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc33fa-c15e-405b-93e2-982ca4a3ad8e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:47.708372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb8f79-26ef-4e19-a823-dc950275a8ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:47.708970 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb8f79-26ef-4e19-a823-dc950275a8ca service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:47.709247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb8f79-26ef-4e19-a823-dc950275a8ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:47.709516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb8f79-26ef-4e19-a823-dc950275a8ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:47.759753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:47.760326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:47.764294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:47.780077 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb8f79-26ef-4e19-a823-dc950275a8ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:47.781596 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb8f79-26ef-4e19-a823-dc950275a8ca service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:47.790987 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1187/2380] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:47.836968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8c26c-4ed3-47b9-a97b-728dd20f9cf5 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:47.842370 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:47.843041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:47.843322 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:47.843599 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] PATH_INFO: `/v3/users/1ee653a68f2842b0b8f97aa560697303` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:47.844725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee653a68f2842b0b8f97aa560697303)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:47.846712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:47.908447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee653a68f2842b0b8f97aa560697303'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:47.909133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee653a68f2842b0b8f97aa560697303'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:47.916331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee653a68f2842b0b8f97aa560697303'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:47.930921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee653a68f2842b0b8f97aa560697303'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:47.931624 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee653a68f2842b0b8f97aa560697303'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:47.946461 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1194/2381] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:47 2022] DELETE /identity/v3/users/1ee653a68f2842b0b8f97aa560697303 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:48.166022 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb8f79-26ef-4e19-a823-dc950275a8ca service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:48.178317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb8f79-26ef-4e19-a823-dc950275a8ca service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:48.237920 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:48.238582 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:48.238865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:48.239140 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] PATH_INFO: `/v3/projects/a2fad667fcdf479f99f8b8d502b40395` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:48.240289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fad667fcdf479f99f8b8d502b40395)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:48.242217 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:48.289021 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fad667fcdf479f99f8b8d502b40395', 'request_id': 'req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.295552 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fad667fcdf479f99f8b8d502b40395', 'request_id': 'req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.301465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fad667fcdf479f99f8b8d502b40395', 'request_id': 'req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.313398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] The token cache is being invalidate because project a2fad667fcdf479f99f8b8d502b40395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:48.313691 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.314384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.315901 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1188/2382] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:48 2022] DELETE /identity/v3/projects/a2fad667fcdf479f99f8b8d502b40395 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:48.320001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:48.321425 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:48.335380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb8665-989e-4fa9-bc83-f23165ffbf34 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:48.373962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:48.393652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:48.394281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:48.394585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:48.394859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] PATH_INFO: `/v3/users/9999211a9d4640aea49f661fe9be738a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:48.395967 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9999211a9d4640aea49f661fe9be738a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:48.397864 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:48.445679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9999211a9d4640aea49f661fe9be738a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.446327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9999211a9d4640aea49f661fe9be738a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.455655 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9999211a9d4640aea49f661fe9be738a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.469002 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9999211a9d4640aea49f661fe9be738a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.469704 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9999211a9d4640aea49f661fe9be738a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.484398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1195/2383] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:48 2022] DELETE /identity/v3/users/9999211a9d4640aea49f661fe9be738a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:48.677382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:48.679238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:48.695017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7600a2d-184e-45b9-a2d6-14f477b4c2f1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:48.762885 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:48.763551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:48.763855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:48.764129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] PATH_INFO: `/v3/projects/ea3a63d14e1e4269a3ba4c496e4a05c6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:48.765318 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3a63d14e1e4269a3ba4c496e4a05c6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:48.767303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:48.779948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:48.821824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3a63d14e1e4269a3ba4c496e4a05c6', 'request_id': 'req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.831358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3a63d14e1e4269a3ba4c496e4a05c6', 'request_id': 'req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.837117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3a63d14e1e4269a3ba4c496e4a05c6', 'request_id': 'req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.850821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] The token cache is being invalidate because project ea3a63d14e1e4269a3ba4c496e4a05c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:48.851111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.851736 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-46be75f8-aa70-47d4-8e7f-4d98f2d46e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:48.853231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1189/2384] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:48 2022] DELETE /identity/v3/projects/ea3a63d14e1e4269a3ba4c496e4a05c6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:49.186062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:49.187730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:49.202859 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293af29-7389-4421-aa40-0a1943822571 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:49.262137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:49.262816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:49.263109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:49.263380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] PATH_INFO: `/v3/users/e24fbb91a07d430f830743aa0c519a39` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:49.264517 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24fbb91a07d430f830743aa0c519a39)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:49.266479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:49.322406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24fbb91a07d430f830743aa0c519a39'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.323184 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24fbb91a07d430f830743aa0c519a39'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.330887 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24fbb91a07d430f830743aa0c519a39'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.335519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:49.345737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24fbb91a07d430f830743aa0c519a39'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.346495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24fbb91a07d430f830743aa0c519a39'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.363076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1196/2385] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:49 2022] DELETE /identity/v3/users/e24fbb91a07d430f830743aa0c519a39 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:49.364943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235dd6-775d-48ac-9d13-bfa1255aa5f7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:49.365254 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235dd6-775d-48ac-9d13-bfa1255aa5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:49.365552 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235dd6-775d-48ac-9d13-bfa1255aa5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:49.384132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-3c235dd6-775d-48ac-9d13-bfa1255aa5f7 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:49.385309 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3c235dd6-775d-48ac-9d13-bfa1255aa5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:49.446444 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1190/2386] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:49.456972 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:49.458367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:49.517993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7164-34f4-4a08-89f5-41e7118b5fa6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:49.521675 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969a12-7091-4033-aee9-576ec9620891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:49.522357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969a12-7091-4033-aee9-576ec9620891 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:49.522672 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969a12-7091-4033-aee9-576ec9620891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:49.522954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969a12-7091-4033-aee9-576ec9620891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:49.532566 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969a12-7091-4033-aee9-576ec9620891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:49.534026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969a12-7091-4033-aee9-576ec9620891 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:49.544265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1197/2387] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:49.810849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c235dd6-775d-48ac-9d13-bfa1255aa5f7 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:49.812382 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3c235dd6-775d-48ac-9d13-bfa1255aa5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:49.829344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c235dd6-775d-48ac-9d13-bfa1255aa5f7 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:49.834220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:49.834881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:49.835200 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:49.835469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] PATH_INFO: `/v3/projects/8512d23b0eba4c01a2ffdf43b91de9d2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:49.836609 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8512d23b0eba4c01a2ffdf43b91de9d2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:49.838634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:49.885290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8512d23b0eba4c01a2ffdf43b91de9d2', 'request_id': 'req-f7320d29-7b23-49e8-90c0-a816d832b33d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.892466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8512d23b0eba4c01a2ffdf43b91de9d2', 'request_id': 'req-f7320d29-7b23-49e8-90c0-a816d832b33d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.898121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8512d23b0eba4c01a2ffdf43b91de9d2', 'request_id': 'req-f7320d29-7b23-49e8-90c0-a816d832b33d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.911218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] The token cache is being invalidate because project 8512d23b0eba4c01a2ffdf43b91de9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:49.911521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.912125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:49.913595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1191/2388] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:49 2022] DELETE /identity/v3/projects/8512d23b0eba4c01a2ffdf43b91de9d2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:49.917627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969a12-7091-4033-aee9-576ec9620891 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:49.927161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969a12-7091-4033-aee9-576ec9620891 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:49.984126 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:49.984798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:49.985082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:49.985617 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] PATH_INFO: `/v3/users/56ce7c869ed64dffa6190240e4a06571` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:49.986804 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ce7c869ed64dffa6190240e4a06571)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:49.988738 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:50.044575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ce7c869ed64dffa6190240e4a06571'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.045221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ce7c869ed64dffa6190240e4a06571'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.052341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ce7c869ed64dffa6190240e4a06571'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.064982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ce7c869ed64dffa6190240e4a06571'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.065713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a0c2ae1-c49a-4490-95d1-23a89db55e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ce7c869ed64dffa6190240e4a06571'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.077364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:50.083217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1198/2389] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:49 2022] DELETE /identity/v3/users/56ce7c869ed64dffa6190240e4a06571 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:50.364760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:50.366416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:50.391996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7320d29-7b23-49e8-90c0-a816d832b33d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:50.415517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:50.455913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:50.456549 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.456847 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.457601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] PATH_INFO: `/v3/projects/22ba9519dcc541548b2878aaa621752e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.458283 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ba9519dcc541548b2878aaa621752e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:50.460233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:50.510475 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ba9519dcc541548b2878aaa621752e', 'request_id': 'req-a96b8b94-a25c-4bd7-bc37-67ae952c7632'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.519771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ba9519dcc541548b2878aaa621752e', 'request_id': 'req-a96b8b94-a25c-4bd7-bc37-67ae952c7632'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.526259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ba9519dcc541548b2878aaa621752e', 'request_id': 'req-a96b8b94-a25c-4bd7-bc37-67ae952c7632'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.539572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] The token cache is being invalidate because project 22ba9519dcc541548b2878aaa621752e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:50.539862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.540524 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a96b8b94-a25c-4bd7-bc37-67ae952c7632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:50.541991 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1192/2390] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:50 2022] DELETE /identity/v3/projects/22ba9519dcc541548b2878aaa621752e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:50.549122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8377-1204-4dfb-bbd1-6443d3c0cf5e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.549651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8377-1204-4dfb-bbd1-6443d3c0cf5e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.549750 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8377-1204-4dfb-bbd1-6443d3c0cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.571235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ac5f8377-1204-4dfb-bbd1-6443d3c0cf5e None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:50.572824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ac5f8377-1204-4dfb-bbd1-6443d3c0cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:50.651977 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1199/2391] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:50.659086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa50d7-b73f-4cb9-9ac1-16cfaa50fddf None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.659615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa50d7-b73f-4cb9-9ac1-16cfaa50fddf None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.659956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa50d7-b73f-4cb9-9ac1-16cfaa50fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.687795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0bfa50d7-b73f-4cb9-9ac1-16cfaa50fddf None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:50.689003 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0bfa50d7-b73f-4cb9-9ac1-16cfaa50fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:50.698081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1193/2392] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:50.702511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f8377-1204-4dfb-bbd1-6443d3c0cf5e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:50.712454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f8377-1204-4dfb-bbd1-6443d3c0cf5e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:50.717295 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:50.717894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.718176 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.718452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.719146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:50.719448 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:50.721058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:50.733968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1200/2393] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:50.738682 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa50d7-b73f-4cb9-9ac1-16cfaa50fddf None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:50.748789 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa50d7-b73f-4cb9-9ac1-16cfaa50fddf None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:50.753329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482393c7-49c3-4160-9a39-89f79eac3037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:50.753913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482393c7-49c3-4160-9a39-89f79eac3037 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.754189 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482393c7-49c3-4160-9a39-89f79eac3037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.754458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482393c7-49c3-4160-9a39-89f79eac3037 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.755109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482393c7-49c3-4160-9a39-89f79eac3037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:50.756986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482393c7-49c3-4160-9a39-89f79eac3037 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:50.783642 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1194/2394] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:50 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:50.787831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:50.798462 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ee870-c69c-474f-acde-a98685cf28c6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:50.854130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c2cc-579a-49ae-92bb-acf84c4b2e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:50.855249 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c2cc-579a-49ae-92bb-acf84c4b2e22 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.855863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c2cc-579a-49ae-92bb-acf84c4b2e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.856015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c2cc-579a-49ae-92bb-acf84c4b2e22 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.856522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069c2cc-579a-49ae-92bb-acf84c4b2e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:50.858409 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069c2cc-579a-49ae-92bb-acf84c4b2e22 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:50.879530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1201/2395] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:50 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:50.883710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482393c7-49c3-4160-9a39-89f79eac3037 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:50.893994 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482393c7-49c3-4160-9a39-89f79eac3037 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:50.898567 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398dde-dd78-4514-ad9f-a5ba96491dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:50.899157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398dde-dd78-4514-ad9f-a5ba96491dde admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.899493 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398dde-dd78-4514-ad9f-a5ba96491dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.899769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398dde-dd78-4514-ad9f-a5ba96491dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.900430 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3398dde-dd78-4514-ad9f-a5ba96491dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:50.902255 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3398dde-dd78-4514-ad9f-a5ba96491dde admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:50.912568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1195/2396] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:50.916595 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c2cc-579a-49ae-92bb-acf84c4b2e22 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:50.927505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c2cc-579a-49ae-92bb-acf84c4b2e22 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:50.932196 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19425555-2c56-403d-906f-ac41325ca2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:50.932819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19425555-2c56-403d-906f-ac41325ca2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.933705 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19425555-2c56-403d-906f-ac41325ca2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.933983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19425555-2c56-403d-906f-ac41325ca2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.934658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19425555-2c56-403d-906f-ac41325ca2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:50.936277 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19425555-2c56-403d-906f-ac41325ca2d0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:50.946840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1202/2397] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:50.951214 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398dde-dd78-4514-ad9f-a5ba96491dde admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:50.961107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398dde-dd78-4514-ad9f-a5ba96491dde admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:50.966226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:50.967039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:50.967145 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:50.967810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] PATH_INFO: `/v3/projects/e3b2f137e0154f9ea45baf39b5b36245/users/04a1c69123f248399e57b4f77ebf61bc/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:50.982813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b2f137e0154f9ea45baf39b5b36245, user_id=04a1c69123f248399e57b4f77ebf61bc, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:50.985728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:50.998390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1196/2398] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:50 2022] PUT /identity/v3/projects/e3b2f137e0154f9ea45baf39b5b36245/users/04a1c69123f248399e57b4f77ebf61bc/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:51.003917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c571-f9a7-45c2-a424-7219a5eabefc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:51.004210 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c571-f9a7-45c2-a424-7219a5eabefc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:51.004489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694c571-f9a7-45c2-a424-7219a5eabefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:51.023273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e694c571-f9a7-45c2-a424-7219a5eabefc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:51.024530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e694c571-f9a7-45c2-a424-7219a5eabefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:51.084554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1203/2399] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:51.094484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:51.096253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:51.115515 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694c571-f9a7-45c2-a424-7219a5eabefc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:51.117079 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e694c571-f9a7-45c2-a424-7219a5eabefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:51.129868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694c571-f9a7-45c2-a424-7219a5eabefc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:51.134613 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:51.135382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:51.135665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:51.135942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] PATH_INFO: `/v3/users/0bba2005e6fd44908df978e0061fa2d3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:51.137521 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bba2005e6fd44908df978e0061fa2d3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:51.139519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:51.141134 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:51.159078 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046781e-824e-4d33-b2d6-053986876548 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:51.162828 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768b3b7-2ad4-4eea-a617-701075efba28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:51.163425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b3b7-2ad4-4eea-a617-701075efba28 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:51.163704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b3b7-2ad4-4eea-a617-701075efba28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:51.163980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b3b7-2ad4-4eea-a617-701075efba28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:51.171377 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:51.175232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768b3b7-2ad4-4eea-a617-701075efba28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:51.176890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768b3b7-2ad4-4eea-a617-701075efba28 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:51.189172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1197/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:51.191517 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bba2005e6fd44908df978e0061fa2d3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:51.192205 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bba2005e6fd44908df978e0061fa2d3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:51.199877 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bba2005e6fd44908df978e0061fa2d3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:51.215240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bba2005e6fd44908df978e0061fa2d3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:51.216099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bba2005e6fd44908df978e0061fa2d3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:51.229221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1204/2401] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:51 2022] DELETE /identity/v3/users/0bba2005e6fd44908df978e0061fa2d3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:51.234155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5bb76-e048-4007-8810-eb89db45bf83 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:51.234445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5bb76-e048-4007-8810-eb89db45bf83 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:51.234792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5bb76-e048-4007-8810-eb89db45bf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:51.255996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-04a5bb76-e048-4007-8810-eb89db45bf83 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:51.257211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-04a5bb76-e048-4007-8810-eb89db45bf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:51.322600 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1198/2402] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:51.333989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:51.336076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:51.399978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e10f7-b693-4d63-a355-159c870b9b9c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:51.404164 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:51.404771 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:51.405050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:51.405315 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:51.414443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:51.415891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:51.427119 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1205/2403] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:51.887233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5bb76-e048-4007-8810-eb89db45bf83 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:51.894658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-04a5bb76-e048-4007-8810-eb89db45bf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:51.918941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5bb76-e048-4007-8810-eb89db45bf83 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:51.928753 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:51.929647 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:51.930113 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:51.930606 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] PATH_INFO: `/v3/projects/9abf018bacc44dfc8287403d522744f0` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:51.936981 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abf018bacc44dfc8287403d522744f0)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:51.939849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:51.965996 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:51.968169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:52.066606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487ac5b-5658-4c11-9c4b-87fab3986d12 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:52.087993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abf018bacc44dfc8287403d522744f0', 'request_id': 'req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.104001 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abf018bacc44dfc8287403d522744f0', 'request_id': 'req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.114840 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abf018bacc44dfc8287403d522744f0', 'request_id': 'req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.138115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:52.147948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] The token cache is being invalidate because project 9abf018bacc44dfc8287403d522744f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:52.148226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.152397 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.154380 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:52.155658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:52.156396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:52.156514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1199/2404] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:51 2022] DELETE /identity/v3/projects/9abf018bacc44dfc8287403d522744f0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:52.157151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:52.159814 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:52.162139 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:52.164177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:52.252056 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3bdb-7e8a-45bf-b4db-c8e2c71f730a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:52.260395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:52.263006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:52.265305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:52.266249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:52.266546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:52.266829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] PATH_INFO: `/v3/users/897f7267072a474899f4f576b5ae0b5f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:52.268133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897f7267072a474899f4f576b5ae0b5f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:52.270176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:52.274616 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1206/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:52.294993 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:52.328359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897f7267072a474899f4f576b5ae0b5f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.344911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897f7267072a474899f4f576b5ae0b5f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.352516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897f7267072a474899f4f576b5ae0b5f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.353271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897f7267072a474899f4f576b5ae0b5f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.365293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b46c9882-6092-43c9-bae0-061092c52385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897f7267072a474899f4f576b5ae0b5f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.374573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1200/2406] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:52 2022] DELETE /identity/v3/users/897f7267072a474899f4f576b5ae0b5f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:52.727832 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:52.743611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f4ee0-c6b0-40da-b71b-746d951ace2f service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:52.850794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:52.851921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:52.851921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:52.852427 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] PATH_INFO: `/v3/projects/ca95ba206a9e48449ccf9535014511d7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:52.853991 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca95ba206a9e48449ccf9535014511d7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:52.856828 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:52.950189 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca95ba206a9e48449ccf9535014511d7', 'request_id': 'req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.957777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca95ba206a9e48449ccf9535014511d7', 'request_id': 'req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.970401 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca95ba206a9e48449ccf9535014511d7', 'request_id': 'req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.998367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] The token cache is being invalidate because project ca95ba206a9e48449ccf9535014511d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:52.998711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:52.999505 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1c907aaf-1d0d-4c29-ba87-53eb2757ff98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:53.006948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1207/2407] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:52 2022] DELETE /identity/v3/projects/ca95ba206a9e48449ccf9535014511d7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:53.008869 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b907-0aa1-4610-9318-997a37c2f805 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.009300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b907-0aa1-4610-9318-997a37c2f805 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.009413 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b907-0aa1-4610-9318-997a37c2f805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.048711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9882b907-0aa1-4610-9318-997a37c2f805 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:53.050105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9882b907-0aa1-4610-9318-997a37c2f805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:53.130434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1201/2408] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:53.142172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5436-48cb-4a76-b6d1-a57a6389cd95 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.142621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5436-48cb-4a76-b6d1-a57a6389cd95 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.143044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5436-48cb-4a76-b6d1-a57a6389cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.181568 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f44c5436-48cb-4a76-b6d1-a57a6389cd95 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:53.183235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f44c5436-48cb-4a76-b6d1-a57a6389cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:53.192804 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1208/2409] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:53.197132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882b907-0aa1-4610-9318-997a37c2f805 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.209451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882b907-0aa1-4610-9318-997a37c2f805 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.218034 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.218802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.219180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.219548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.220569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:53.221110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.223206 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.236850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1202/2410] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:05:53.241589 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5436-48cb-4a76-b6d1-a57a6389cd95 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.260822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5436-48cb-4a76-b6d1-a57a6389cd95 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.267862 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d063db-d8c6-4d45-918b-62463f6b39a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.268472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d063db-d8c6-4d45-918b-62463f6b39a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.268796 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d063db-d8c6-4d45-918b-62463f6b39a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.269021 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d063db-d8c6-4d45-918b-62463f6b39a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.269649 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d063db-d8c6-4d45-918b-62463f6b39a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.271667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d063db-d8c6-4d45-918b-62463f6b39a7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.303711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:53.330026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1209/2411] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:53 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:53.338873 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.349703 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53b0d6-6988-4518-89d0-73fdabcdaf36 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.418586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1e145-adbf-4821-8d03-048db4bd2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.419157 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1e145-adbf-4821-8d03-048db4bd2bea admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.419469 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1e145-adbf-4821-8d03-048db4bd2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.419749 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1e145-adbf-4821-8d03-048db4bd2bea admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.420505 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1e145-adbf-4821-8d03-048db4bd2bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.422790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1e145-adbf-4821-8d03-048db4bd2bea admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.450079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1203/2412] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:53 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:53.451691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d063db-d8c6-4d45-918b-62463f6b39a7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.462586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d063db-d8c6-4d45-918b-62463f6b39a7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.467901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097366-684a-4c2d-b40d-905f69dacefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.468509 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097366-684a-4c2d-b40d-905f69dacefe admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.468791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097366-684a-4c2d-b40d-905f69dacefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.469719 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097366-684a-4c2d-b40d-905f69dacefe admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.470378 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29097366-684a-4c2d-b40d-905f69dacefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.472006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29097366-684a-4c2d-b40d-905f69dacefe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.484848 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1210/2413] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:53.488805 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1e145-adbf-4821-8d03-048db4bd2bea admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.499912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1e145-adbf-4821-8d03-048db4bd2bea admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.505681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82c484-106f-4b3c-8c70-664e6c139471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.506320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82c484-106f-4b3c-8c70-664e6c139471 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.506717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82c484-106f-4b3c-8c70-664e6c139471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.506974 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82c484-106f-4b3c-8c70-664e6c139471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.507945 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82c484-106f-4b3c-8c70-664e6c139471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.509680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82c484-106f-4b3c-8c70-664e6c139471 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.522717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1204/2414] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:53.527015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097366-684a-4c2d-b40d-905f69dacefe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.537791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097366-684a-4c2d-b40d-905f69dacefe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.545318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181406a-52f3-41c3-998d-db2ee0b1a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.547080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181406a-52f3-41c3-998d-db2ee0b1a0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.547080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181406a-52f3-41c3-998d-db2ee0b1a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.547080 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181406a-52f3-41c3-998d-db2ee0b1a0d4 admin admin] PATH_INFO: `/v3/projects/fec0b5eba28e4838851965e1ad02b0ee/users/f8e1075b3b204b05a8d91d65089afcf1/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.565019 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181406a-52f3-41c3-998d-db2ee0b1a0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec0b5eba28e4838851965e1ad02b0ee, user_id=f8e1075b3b204b05a8d91d65089afcf1, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.567724 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181406a-52f3-41c3-998d-db2ee0b1a0d4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.582104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1211/2415] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:53 2022] PUT /identity/v3/projects/fec0b5eba28e4838851965e1ad02b0ee/users/f8e1075b3b204b05a8d91d65089afcf1/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:53.592563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f08a84-9ee5-41b9-8afa-4f518e1b35d0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.592848 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f08a84-9ee5-41b9-8afa-4f518e1b35d0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.593121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f08a84-9ee5-41b9-8afa-4f518e1b35d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.600285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:53.630573 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-17f08a84-9ee5-41b9-8afa-4f518e1b35d0 None None] MFA Rules not processed for user `f8e1075b3b204b05a8d91d65089afcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:53.632059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-17f08a84-9ee5-41b9-8afa-4f518e1b35d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:53.697109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1205/2416] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:53.702072 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181406a-52f3-41c3-998d-db2ee0b1a0d4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.781028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181406a-52f3-41c3-998d-db2ee0b1a0d4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.785843 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50314b98-6cf3-4ab3-8222-77b18b68d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.786457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50314b98-6cf3-4ab3-8222-77b18b68d363 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.786779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50314b98-6cf3-4ab3-8222-77b18b68d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.787054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50314b98-6cf3-4ab3-8222-77b18b68d363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.787696 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50314b98-6cf3-4ab3-8222-77b18b68d363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.789582 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50314b98-6cf3-4ab3-8222-77b18b68d363 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.820221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1212/2417] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:53 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:53.824736 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f08a84-9ee5-41b9-8afa-4f518e1b35d0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.836172 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f08a84-9ee5-41b9-8afa-4f518e1b35d0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.914167 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad380a-42cb-4e0c-985a-99beeb275743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.914919 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad380a-42cb-4e0c-985a-99beeb275743 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.915269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad380a-42cb-4e0c-985a-99beeb275743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.915612 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad380a-42cb-4e0c-985a-99beeb275743 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.916323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad380a-42cb-4e0c-985a-99beeb275743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.918417 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad380a-42cb-4e0c-985a-99beeb275743 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.946776 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1206/2418] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:53 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:53.951412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50314b98-6cf3-4ab3-8222-77b18b68d363 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:53.966608 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50314b98-6cf3-4ab3-8222-77b18b68d363 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:53.973300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e25a37-e368-4950-be6b-143121d6dd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:53.973999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e25a37-e368-4950-be6b-143121d6dd37 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:53.974492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e25a37-e368-4950-be6b-143121d6dd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:53.974998 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e25a37-e368-4950-be6b-143121d6dd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:53.975840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e25a37-e368-4950-be6b-143121d6dd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:53.977777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e25a37-e368-4950-be6b-143121d6dd37 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:53.993716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1213/2419] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:53.994938 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad380a-42cb-4e0c-985a-99beeb275743 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:54.006447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad380a-42cb-4e0c-985a-99beeb275743 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:54.013525 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf919-b0e3-4e0c-a124-3f39e15ece31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:54.014152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf919-b0e3-4e0c-a124-3f39e15ece31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:54.014152 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf919-b0e3-4e0c-a124-3f39e15ece31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:54.014354 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf919-b0e3-4e0c-a124-3f39e15ece31 admin admin] PATH_INFO: `/v3/projects/b502878499614dd78d80e90f2510cc5f/users/4d7d905df40b4e68a8873664ed525791/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:54.034671 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdf919-b0e3-4e0c-a124-3f39e15ece31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b502878499614dd78d80e90f2510cc5f, user_id=4d7d905df40b4e68a8873664ed525791, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:54.037746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdf919-b0e3-4e0c-a124-3f39e15ece31 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:54.057151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1207/2420] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:53 2022] PUT /identity/v3/projects/b502878499614dd78d80e90f2510cc5f/users/4d7d905df40b4e68a8873664ed525791/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:54.061896 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e25a37-e368-4950-be6b-143121d6dd37 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:54.075611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e25a37-e368-4950-be6b-143121d6dd37 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:54.164773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66784c-8ce0-4279-b949-73a5e377b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:54.165489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66784c-8ce0-4279-b949-73a5e377b217 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:54.165838 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66784c-8ce0-4279-b949-73a5e377b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:54.166255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66784c-8ce0-4279-b949-73a5e377b217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:54.167128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66784c-8ce0-4279-b949-73a5e377b217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:54.171541 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66784c-8ce0-4279-b949-73a5e377b217 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:54.186712 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1214/2421] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:54.188890 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf919-b0e3-4e0c-a124-3f39e15ece31 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:54.201284 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf919-b0e3-4e0c-a124-3f39e15ece31 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:54.206597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:54.207522 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:54.208185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:54.208683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] PATH_INFO: `/v3/projects/b502878499614dd78d80e90f2510cc5f/users/4d7d905df40b4e68a8873664ed525791/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:54.211112 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b502878499614dd78d80e90f2510cc5f, user_id=4d7d905df40b4e68a8873664ed525791, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:54.215696 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:54.249677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1208/2422] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:54 2022] PUT /identity/v3/projects/b502878499614dd78d80e90f2510cc5f/users/4d7d905df40b4e68a8873664ed525791/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:54.251627 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df392-40dc-4988-910d-1c6d7bf0eb80 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:54.251924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df392-40dc-4988-910d-1c6d7bf0eb80 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:54.252232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df392-40dc-4988-910d-1c6d7bf0eb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:54.289140 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-709df392-40dc-4988-910d-1c6d7bf0eb80 None None] MFA Rules not processed for user `4d7d905df40b4e68a8873664ed525791`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:54.290748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-709df392-40dc-4988-910d-1c6d7bf0eb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:54.316699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:54.440671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1215/2423] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:54.450695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:54.452700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:54.562066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:54.586986 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c827-6c3c-490c-99f7-861571371f6a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:54.594191 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fc27c-9732-41aa-a988-f780df09da15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:54.597716 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc27c-9732-41aa-a988-f780df09da15 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:54.598105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc27c-9732-41aa-a988-f780df09da15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:54.598452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc27c-9732-41aa-a988-f780df09da15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:54.615712 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fc27c-9732-41aa-a988-f780df09da15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:54.617820 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fc27c-9732-41aa-a988-f780df09da15 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:54.643677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1209/2424] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:55.086128 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df392-40dc-4988-910d-1c6d7bf0eb80 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:55.087669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-709df392-40dc-4988-910d-1c6d7bf0eb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:55.194357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df392-40dc-4988-910d-1c6d7bf0eb80 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:55.201165 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:55.202794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:55.203185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:55.203571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] PATH_INFO: `/v3/users/5f06dd9851704fa183d2b9056e26f931` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:55.205015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f06dd9851704fa183d2b9056e26f931)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:55.207438 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:55.238743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fc27c-9732-41aa-a988-f780df09da15 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:55.253178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fc27c-9732-41aa-a988-f780df09da15 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:55.259181 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:55.260325 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:55.261301 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:55.261725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] PATH_INFO: `/v3/users/f8e1075b3b204b05a8d91d65089afcf1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:55.263282 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e1075b3b204b05a8d91d65089afcf1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:55.265392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:55.302943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f06dd9851704fa183d2b9056e26f931'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.304226 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f06dd9851704fa183d2b9056e26f931'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.332062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f06dd9851704fa183d2b9056e26f931'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.365868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f06dd9851704fa183d2b9056e26f931'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.366948 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-58276a15-d4c2-4a92-af06-8831e4b0ef69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f06dd9851704fa183d2b9056e26f931'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.376843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e1075b3b204b05a8d91d65089afcf1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.393623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1216/2425] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:55 2022] DELETE /identity/v3/users/5f06dd9851704fa183d2b9056e26f931 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:55.399956 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184b79-9605-406c-8ea8-24332e3a7860 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:55.400607 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184b79-9605-406c-8ea8-24332e3a7860 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:55.401774 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184b79-9605-406c-8ea8-24332e3a7860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:55.409379 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e1075b3b204b05a8d91d65089afcf1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.424230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e1075b3b204b05a8d91d65089afcf1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.424997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e1075b3b204b05a8d91d65089afcf1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.425267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f2184b79-9605-406c-8ea8-24332e3a7860 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:55.426778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f2184b79-9605-406c-8ea8-24332e3a7860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:55.435245 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0851984-46c7-4e6b-8671-8bf5c36ad6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e1075b3b204b05a8d91d65089afcf1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:55.445441 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1210/2426] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:55 2022] DELETE /identity/v3/users/f8e1075b3b204b05a8d91d65089afcf1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:55.447565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9870-b92f-490f-a5f2-966883e87dca None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:55.447867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9870-b92f-490f-a5f2-966883e87dca None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:55.448344 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9870-b92f-490f-a5f2-966883e87dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:55.472119 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-807c9870-b92f-490f-a5f2-966883e87dca None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:55.473401 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-807c9870-b92f-490f-a5f2-966883e87dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:55.483007 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:55.532754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1217/2427] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:55.544243 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2184b79-9605-406c-8ea8-24332e3a7860 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:55.547980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f2184b79-9605-406c-8ea8-24332e3a7860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:55.584954 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1211/2428] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:55.595792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c9870-b92f-490f-a5f2-966883e87dca None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:55.597465 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-807c9870-b92f-490f-a5f2-966883e87dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:55.660929 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2184b79-9605-406c-8ea8-24332e3a7860 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:55.705997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c9870-b92f-490f-a5f2-966883e87dca None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:55.710422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:55.711207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:55.711672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:55.712136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:55.726775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:55.728190 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:55.737957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81370776-b6ff-4011-a981-cc25505287f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:55.738894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370776-b6ff-4011-a981-cc25505287f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:55.739240 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370776-b6ff-4011-a981-cc25505287f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:55.739586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370776-b6ff-4011-a981-cc25505287f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:55.742952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1212/2429] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:55.751053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81370776-b6ff-4011-a981-cc25505287f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:55.753279 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81370776-b6ff-4011-a981-cc25505287f7 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:55.764823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1218/2430] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:05:56.217027 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.218629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:56.229109 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:56.236215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb51f96-648d-4b60-9bcb-1500569c241e service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:56.243874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:56.246158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.247293 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.247882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] PATH_INFO: `/v3/projects/fec0b5eba28e4838851965e1ad02b0ee` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.249216 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec0b5eba28e4838851965e1ad02b0ee)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:56.251537 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:56.320015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928090af-2e86-4726-9e5b-edccde76451d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.320933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928090af-2e86-4726-9e5b-edccde76451d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.321363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928090af-2e86-4726-9e5b-edccde76451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.326936 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec0b5eba28e4838851965e1ad02b0ee', 'request_id': 'req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.352503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec0b5eba28e4838851965e1ad02b0ee', 'request_id': 'req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.361277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec0b5eba28e4838851965e1ad02b0ee', 'request_id': 'req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.363254 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-928090af-2e86-4726-9e5b-edccde76451d None None] MFA Rules not processed for user `04a1c69123f248399e57b4f77ebf61bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:56.364625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-928090af-2e86-4726-9e5b-edccde76451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:56.382033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] The token cache is being invalidate because project fec0b5eba28e4838851965e1ad02b0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:56.382332 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.383357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.387976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1213/2431] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:56 2022] DELETE /identity/v3/projects/fec0b5eba28e4838851965e1ad02b0ee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:56.387976 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.389359 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:56.452444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1219/2432] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:56.453402 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928090af-2e86-4726-9e5b-edccde76451d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.454807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-928090af-2e86-4726-9e5b-edccde76451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:56.468447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab28f5-a96b-4bfb-b3d8-bef26584edf4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:56.474355 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:56.475709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.476098 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.476481 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] PATH_INFO: `/v3/projects/e795ffc4ee5b4dbe911f2bcf23ebae0e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.478067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e795ffc4ee5b4dbe911f2bcf23ebae0e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:56.480941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:56.483812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:56.529235 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928090af-2e86-4726-9e5b-edccde76451d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:56.543057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e795ffc4ee5b4dbe911f2bcf23ebae0e', 'request_id': 'req-8414b360-f297-4839-861c-8e9f919cc94c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.551569 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e795ffc4ee5b4dbe911f2bcf23ebae0e', 'request_id': 'req-8414b360-f297-4839-861c-8e9f919cc94c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.559383 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e795ffc4ee5b4dbe911f2bcf23ebae0e', 'request_id': 'req-8414b360-f297-4839-861c-8e9f919cc94c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.574459 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] The token cache is being invalidate because project e795ffc4ee5b4dbe911f2bcf23ebae0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:56.574915 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.575709 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.580142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1214/2433] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:56 2022] DELETE /identity/v3/projects/e795ffc4ee5b4dbe911f2bcf23ebae0e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:56.580142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.581532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:56.595652 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:56.596590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.596874 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.597208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] PATH_INFO: `/v3/users/4d7d905df40b4e68a8873664ed525791` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.598398 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7d905df40b4e68a8873664ed525791)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:56.600486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:56.602154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:56.658224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7d905df40b4e68a8873664ed525791'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.658993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7d905df40b4e68a8873664ed525791'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.660477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414b360-f297-4839-861c-8e9f919cc94c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:56.665583 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:56.666307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.666618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.666888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7d905df40b4e68a8873664ed525791'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.667650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.668467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:56.670391 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:56.681904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7d905df40b4e68a8873664ed525791'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.683563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7d905df40b4e68a8873664ed525791'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.702063 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1220/2434] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:56 2022] DELETE /identity/v3/users/4d7d905df40b4e68a8873664ed525791 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:56.705300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.705300 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:56.708687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1215/2435] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:56 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:56.712615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.715433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:56.767697 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:56.789162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbde86-4d51-44b0-b94a-fa35c33c8ac8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:56.792315 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a67e18-6b2f-4ca4-9b07-a64747c56464 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:56.796942 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:56.797702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.797858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb1896-ebd8-46ec-bc1d-a67b6dbfb8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:56.798120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.798463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] PATH_INFO: `/v3/users/38673a2eb2c54ba5832b56625355b1ea` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.798736 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb1896-ebd8-46ec-bc1d-a67b6dbfb8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.799143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb1896-ebd8-46ec-bc1d-a67b6dbfb8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.799431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb1896-ebd8-46ec-bc1d-a67b6dbfb8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.799901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] RBAC: Authorizing `identity:delete_user(user_id=38673a2eb2c54ba5832b56625355b1ea)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:56.800209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb1896-ebd8-46ec-bc1d-a67b6dbfb8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:56.801954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:56.802260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb1896-ebd8-46ec-bc1d-a67b6dbfb8a9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:56.828821 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1216/2436] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:56 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:56.833064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb1896-ebd8-46ec-bc1d-a67b6dbfb8a9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.845414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb1896-ebd8-46ec-bc1d-a67b6dbfb8a9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:56.850589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d192de-5968-482c-ba3b-efce6726ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:56.851672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d192de-5968-482c-ba3b-efce6726ceb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.851956 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d192de-5968-482c-ba3b-efce6726ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.852229 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d192de-5968-482c-ba3b-efce6726ceb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.852872 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d192de-5968-482c-ba3b-efce6726ceb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:56.854586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d192de-5968-482c-ba3b-efce6726ceb7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:56.871031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1217/2437] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:56.871824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d192de-5968-482c-ba3b-efce6726ceb7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.876329 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38673a2eb2c54ba5832b56625355b1ea'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.877703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38673a2eb2c54ba5832b56625355b1ea'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.883519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d192de-5968-482c-ba3b-efce6726ceb7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:56.889510 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:56.890247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:56.890681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:56.891066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] PATH_INFO: `/v3/projects/1cf210063297426bbf603fdaec71b973/users/7060db7cf84d491ba49034fbdfbdad1d/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:56.899343 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38673a2eb2c54ba5832b56625355b1ea'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.909399 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf210063297426bbf603fdaec71b973, user_id=7060db7cf84d491ba49034fbdfbdad1d, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:56.912238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:56.914319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38673a2eb2c54ba5832b56625355b1ea'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.915129 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38673a2eb2c54ba5832b56625355b1ea'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:56.930730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1218/2438] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:56 2022] PUT /identity/v3/projects/1cf210063297426bbf603fdaec71b973/users/7060db7cf84d491ba49034fbdfbdad1d/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:56.931749 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1221/2439] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:56 2022] DELETE /identity/v3/users/38673a2eb2c54ba5832b56625355b1ea => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:56.939746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:56.941742 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:57.029797 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.031844 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:57.056312 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:57.064385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616d455-6ce7-4edb-8f0d-67eb94ff851d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.117155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14128d7-fcc5-4c79-9214-67b1daa8dfff admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.124495 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.125431 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.125791 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.126711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] PATH_INFO: `/v3/projects/b502878499614dd78d80e90f2510cc5f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.128024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b502878499614dd78d80e90f2510cc5f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.130823 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.162432 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8537-f0f1-4f7e-8162-1b69188b3be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.163287 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8537-f0f1-4f7e-8162-1b69188b3be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.163737 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8537-f0f1-4f7e-8162-1b69188b3be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.164118 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8537-f0f1-4f7e-8162-1b69188b3be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.164944 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8537-f0f1-4f7e-8162-1b69188b3be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.167628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8537-f0f1-4f7e-8162-1b69188b3be5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.185517 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1219/2440] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:57.186566 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8537-f0f1-4f7e-8162-1b69188b3be5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.199440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8537-f0f1-4f7e-8162-1b69188b3be5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.210193 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b502878499614dd78d80e90f2510cc5f', 'request_id': 'req-158639bd-07de-4a7a-b7b9-d5f8a885761e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.219253 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b502878499614dd78d80e90f2510cc5f', 'request_id': 'req-158639bd-07de-4a7a-b7b9-d5f8a885761e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.228580 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b502878499614dd78d80e90f2510cc5f', 'request_id': 'req-158639bd-07de-4a7a-b7b9-d5f8a885761e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.242938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:57.258321 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] The token cache is being invalidate because project b502878499614dd78d80e90f2510cc5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:57.258824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.259808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-158639bd-07de-4a7a-b7b9-d5f8a885761e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.266995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1222/2441] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:57 2022] DELETE /identity/v3/projects/b502878499614dd78d80e90f2510cc5f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:57.268611 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0eaa-189e-4b5f-83a2-5c68fb486973 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.269054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0eaa-189e-4b5f-83a2-5c68fb486973 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.269209 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0eaa-189e-4b5f-83a2-5c68fb486973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.298919 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-88ac0eaa-189e-4b5f-83a2-5c68fb486973 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:57.301067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-88ac0eaa-189e-4b5f-83a2-5c68fb486973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:57.301880 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.302687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.303035 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.303610 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] PATH_INFO: `/v3/projects/1cf210063297426bbf603fdaec71b973/users/7060db7cf84d491ba49034fbdfbdad1d/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.305849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf210063297426bbf603fdaec71b973, user_id=7060db7cf84d491ba49034fbdfbdad1d, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.309435 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.323840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1223/2442] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:57.327620 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7f0de-1865-4195-8837-f36d87ef2342 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.327980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7f0de-1865-4195-8837-f36d87ef2342 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.328317 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7f0de-1865-4195-8837-f36d87ef2342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.337009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1220/2443] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:57 2022] PUT /identity/v3/projects/1cf210063297426bbf603fdaec71b973/users/7060db7cf84d491ba49034fbdfbdad1d/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:57.347674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.350700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:57.383406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ada7f0de-1865-4195-8837-f36d87ef2342 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:57.384836 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ada7f0de-1865-4195-8837-f36d87ef2342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:57.470183 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1224/2444] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:57.474621 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7f0de-1865-4195-8837-f36d87ef2342 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.479962 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208c3b-4bda-491a-9a3d-36b420e1c98f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.485708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7f0de-1865-4195-8837-f36d87ef2342 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.487686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.488980 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.489720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.490219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] PATH_INFO: `/v3/projects/3c8e72b70a2c43e08fe8139a0ea27b1a` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.492188 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8e72b70a2c43e08fe8139a0ea27b1a)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.492656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.493354 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.493640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.493915 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.494603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:57.494904 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.496629 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.497004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.514552 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1225/2445] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:05:57.515917 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.529564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6f83c-f3d2-4e67-808f-c7b8d4b56087 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.535651 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8906-450d-41bc-9872-d0a5db89f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.536481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8906-450d-41bc-9872-d0a5db89f035 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.536912 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8906-450d-41bc-9872-d0a5db89f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.537054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8906-450d-41bc-9872-d0a5db89f035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.538054 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8906-450d-41bc-9872-d0a5db89f035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.541507 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8906-450d-41bc-9872-d0a5db89f035 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.543942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:57.560836 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8e72b70a2c43e08fe8139a0ea27b1a', 'request_id': 'req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.571106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8e72b70a2c43e08fe8139a0ea27b1a', 'request_id': 'req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.578740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8e72b70a2c43e08fe8139a0ea27b1a', 'request_id': 'req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.581178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1226/2446] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:57 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:57.582172 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8906-450d-41bc-9872-d0a5db89f035 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.597764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] The token cache is being invalidate because project 3c8e72b70a2c43e08fe8139a0ea27b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:57.598137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.599608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.603784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1221/2447] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:57 2022] DELETE /identity/v3/projects/3c8e72b70a2c43e08fe8139a0ea27b1a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:57.611019 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.614143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:57.666748 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8906-450d-41bc-9872-d0a5db89f035 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.675288 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.676331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.676855 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.677024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.677900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.680416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.696074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1382bd-d7cd-4b8e-b3c8-89d4ace6a7ca admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.701887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.702774 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.703061 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.703454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] PATH_INFO: `/v3/users/2befc98ab04544e8a9356a05dd8ed515` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.704677 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2befc98ab04544e8a9356a05dd8ed515)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.706388 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1227/2448] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:57 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:57.710817 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.711274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.715631 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:57.742662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48272-fef7-4577-9b2d-47bfb2ba0cf9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.749116 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eb8e5-60f3-424e-a1b7-13079039b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.750831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb8e5-60f3-424e-a1b7-13079039b176 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.750831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb8e5-60f3-424e-a1b7-13079039b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.750831 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb8e5-60f3-424e-a1b7-13079039b176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.751268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eb8e5-60f3-424e-a1b7-13079039b176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.752826 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eb8e5-60f3-424e-a1b7-13079039b176 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.779268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1228/2449] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:57.781835 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eb8e5-60f3-424e-a1b7-13079039b176 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.787207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2befc98ab04544e8a9356a05dd8ed515'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.795685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eb8e5-60f3-424e-a1b7-13079039b176 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.807429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cde7c-9b0d-413f-8233-f235ea56cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.808736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cde7c-9b0d-413f-8233-f235ea56cea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.809432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cde7c-9b0d-413f-8233-f235ea56cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.810067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cde7c-9b0d-413f-8233-f235ea56cea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.810746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2befc98ab04544e8a9356a05dd8ed515'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.811430 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cde7c-9b0d-413f-8233-f235ea56cea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.814952 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cde7c-9b0d-413f-8233-f235ea56cea6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:57.819138 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2befc98ab04544e8a9356a05dd8ed515'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.820261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2befc98ab04544e8a9356a05dd8ed515'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.830658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2befc98ab04544e8a9356a05dd8ed515'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:57.839724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1222/2451] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:57 2022] DELETE /identity/v3/users/2befc98ab04544e8a9356a05dd8ed515 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:57.839964 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1229/2451] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:57.844086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:57.848057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:57.921971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:57.958889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4f03-f298-4233-afa7-7884aeee3fdb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:57.966070 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92adf4-27fa-4085-bd6b-93ac809a903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:57.967767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92adf4-27fa-4085-bd6b-93ac809a903e admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:57.968186 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92adf4-27fa-4085-bd6b-93ac809a903e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:57.968724 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92adf4-27fa-4085-bd6b-93ac809a903e admin admin] PATH_INFO: `/v3/projects/df315359cd5349c7950cd41c6a54ecf8/users/5ff8d3f378dc4192b124594ffd744b0a/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:57.987514 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92adf4-27fa-4085-bd6b-93ac809a903e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df315359cd5349c7950cd41c6a54ecf8, user_id=5ff8d3f378dc4192b124594ffd744b0a, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:57.990833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92adf4-27fa-4085-bd6b-93ac809a903e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.017227 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1223/2452] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:57 2022] PUT /identity/v3/projects/df315359cd5349c7950cd41c6a54ecf8/users/5ff8d3f378dc4192b124594ffd744b0a/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:58.028590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9556fa-b350-4df8-89e0-a145f69840d7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.029144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9556fa-b350-4df8-89e0-a145f69840d7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.029479 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9556fa-b350-4df8-89e0-a145f69840d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.073890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ab9556fa-b350-4df8-89e0-a145f69840d7 None None] MFA Rules not processed for user `5ff8d3f378dc4192b124594ffd744b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:58.076084 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ab9556fa-b350-4df8-89e0-a145f69840d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:58.095758 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:58.181484 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1230/2453] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:58.187037 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92adf4-27fa-4085-bd6b-93ac809a903e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.264932 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9556fa-b350-4df8-89e0-a145f69840d7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.266365 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ab9556fa-b350-4df8-89e0-a145f69840d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:58.306900 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92adf4-27fa-4085-bd6b-93ac809a903e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.324422 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb81d-41bd-4b9d-b2cd-08903438e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.325913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb81d-41bd-4b9d-b2cd-08903438e5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.327357 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb81d-41bd-4b9d-b2cd-08903438e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.327660 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb81d-41bd-4b9d-b2cd-08903438e5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.328581 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb81d-41bd-4b9d-b2cd-08903438e5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.332700 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb81d-41bd-4b9d-b2cd-08903438e5f7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.382654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1224/2454] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:58 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:58.387610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9556fa-b350-4df8-89e0-a145f69840d7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.392117 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb81d-41bd-4b9d-b2cd-08903438e5f7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.468124 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.468769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.469051 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.469331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] PATH_INFO: `/v3/projects/65840fda10cc49e0a05095fbf43937bf` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.470586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=65840fda10cc49e0a05095fbf43937bf)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.472643 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.485558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb81d-41bd-4b9d-b2cd-08903438e5f7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.491978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324000-7a53-46a3-90c3-b64513158d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.492760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324000-7a53-46a3-90c3-b64513158d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.493361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324000-7a53-46a3-90c3-b64513158d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.493652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3324000-7a53-46a3-90c3-b64513158d99 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.494307 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3324000-7a53-46a3-90c3-b64513158d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.497164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3324000-7a53-46a3-90c3-b64513158d99 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.523349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1225/2455] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:58 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:58.527710 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324000-7a53-46a3-90c3-b64513158d99 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.540679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65840fda10cc49e0a05095fbf43937bf', 'request_id': 'req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:58.541405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3324000-7a53-46a3-90c3-b64513158d99 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.549024 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65840fda10cc49e0a05095fbf43937bf', 'request_id': 'req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:58.557858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65840fda10cc49e0a05095fbf43937bf', 'request_id': 'req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:58.559736 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:58.582045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] The token cache is being invalidate because project 65840fda10cc49e0a05095fbf43937bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:05:58.583567 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:58.584507 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a699a1c6-ba0d-438c-b481-8563d7bbfd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:05:58.586591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:58.589768 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1231/2456] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:05:58 2022] DELETE /identity/v3/projects/65840fda10cc49e0a05095fbf43937bf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:05:58.596535 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295947c8-fc8e-4e20-a60a-cdc44c195529 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.597086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295947c8-fc8e-4e20-a60a-cdc44c195529 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.597519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295947c8-fc8e-4e20-a60a-cdc44c195529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.611096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.611877 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.612260 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.612637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.613433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.615326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.629201 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1226/2457] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:58.633419 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.637001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-295947c8-fc8e-4e20-a60a-cdc44c195529 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:58.638186 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:58.639723 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-295947c8-fc8e-4e20-a60a-cdc44c195529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:58.656840 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1232/2458] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:58.659597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3836c4-86d2-4ab3-be8b-d82e841d2f55 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.666227 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa6fc-1a6a-4a84-8b9a-f537bb01777f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.666706 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa6fc-1a6a-4a84-8b9a-f537bb01777f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.667142 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa6fc-1a6a-4a84-8b9a-f537bb01777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.668769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f637664-9202-4a57-af2f-47a9ee0e8878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.670253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f637664-9202-4a57-af2f-47a9ee0e8878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.670995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f637664-9202-4a57-af2f-47a9ee0e8878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.671438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f637664-9202-4a57-af2f-47a9ee0e8878 admin admin] PATH_INFO: `/v3/projects/a7baa2d9b73c4874b117f75e2d1d6b1c/users/b34370a8c2724c8f8d6b88a8949be9cd/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.693710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-48efa6fc-1a6a-4a84-8b9a-f537bb01777f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:58.695127 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f637664-9202-4a57-af2f-47a9ee0e8878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7baa2d9b73c4874b117f75e2d1d6b1c, user_id=b34370a8c2724c8f8d6b88a8949be9cd, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.695653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-48efa6fc-1a6a-4a84-8b9a-f537bb01777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:58.699800 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f637664-9202-4a57-af2f-47a9ee0e8878 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.708411 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1233/2459] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:05:58.712892 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa6fc-1a6a-4a84-8b9a-f537bb01777f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.719303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1227/2460] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:58 2022] PUT /identity/v3/projects/a7baa2d9b73c4874b117f75e2d1d6b1c/users/b34370a8c2724c8f8d6b88a8949be9cd/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:58.724185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f637664-9202-4a57-af2f-47a9ee0e8878 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.732174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa6fc-1a6a-4a84-8b9a-f537bb01777f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.827889 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f637664-9202-4a57-af2f-47a9ee0e8878 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.833950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.834845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be3eed-d774-43ce-b879-6f44e5e7539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.835058 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.835447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.835827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.836312 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3eed-d774-43ce-b879-6f44e5e7539d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.836773 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:05:58.836966 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3eed-d774-43ce-b879-6f44e5e7539d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.837319 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.837550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3eed-d774-43ce-b879-6f44e5e7539d admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.838362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be3eed-d774-43ce-b879-6f44e5e7539d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.841237 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be3eed-d774-43ce-b879-6f44e5e7539d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.841709 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.860519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1234/2461] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:05:58.861497 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1228/2462] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:58.862257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.865523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be3eed-d774-43ce-b879-6f44e5e7539d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.876681 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f26c-d34d-4907-9e46-9a66bb2948be admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.887057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be3eed-d774-43ce-b879-6f44e5e7539d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:58.892936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75a839-1e43-4702-b3f0-763396746868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.892936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75a839-1e43-4702-b3f0-763396746868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.892936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75a839-1e43-4702-b3f0-763396746868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.892936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75a839-1e43-4702-b3f0-763396746868 admin admin] PATH_INFO: `/v3/projects/a7baa2d9b73c4874b117f75e2d1d6b1c/users/b34370a8c2724c8f8d6b88a8949be9cd/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.898327 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75a839-1e43-4702-b3f0-763396746868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7baa2d9b73c4874b117f75e2d1d6b1c, user_id=b34370a8c2724c8f8d6b88a8949be9cd, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.899218 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60559f5-9688-42fa-b085-d786e693e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:58.900363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60559f5-9688-42fa-b085-d786e693e477 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.902654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60559f5-9688-42fa-b085-d786e693e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.903168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60559f5-9688-42fa-b085-d786e693e477 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.903846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75a839-1e43-4702-b3f0-763396746868 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.904211 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60559f5-9688-42fa-b085-d786e693e477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:58.906345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60559f5-9688-42fa-b085-d786e693e477 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:58.922576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1235/2463] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:58 2022] PUT /identity/v3/projects/a7baa2d9b73c4874b117f75e2d1d6b1c/users/b34370a8c2724c8f8d6b88a8949be9cd/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:58.931563 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb6e1-0d55-4c72-8969-a774900b72b8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:58.931926 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb6e1-0d55-4c72-8969-a774900b72b8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:58.932239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb6e1-0d55-4c72-8969-a774900b72b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:58.962182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1229/2464] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:58 2022] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:58.963706 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60559f5-9688-42fa-b085-d786e693e477 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:58.972281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d72fb6e1-0d55-4c72-8969-a774900b72b8 None None] MFA Rules not processed for user `b34370a8c2724c8f8d6b88a8949be9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:58.973593 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d72fb6e1-0d55-4c72-8969-a774900b72b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:59.096530 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1236/2465] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:59.106756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb6e1-0d55-4c72-8969-a774900b72b8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:59.108665 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d72fb6e1-0d55-4c72-8969-a774900b72b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:59.126797 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60559f5-9688-42fa-b085-d786e693e477 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:59.131754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98fcaf-ed20-47f0-bf81-919dba68c681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:59.132838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fcaf-ed20-47f0-bf81-919dba68c681 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.132838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fcaf-ed20-47f0-bf81-919dba68c681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.133059 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fcaf-ed20-47f0-bf81-919dba68c681 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.133761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98fcaf-ed20-47f0-bf81-919dba68c681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:59.136392 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98fcaf-ed20-47f0-bf81-919dba68c681 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:59.167773 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1230/2466] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:58 2022] POST /identity/v3/users => generated 305 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:05:59.169129 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98fcaf-ed20-47f0-bf81-919dba68c681 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:59.181452 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98fcaf-ed20-47f0-bf81-919dba68c681 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:59.185146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:59.194480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b1974-0881-4d0f-b8da-0108e9f2493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:59.196767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1974-0881-4d0f-b8da-0108e9f2493c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.197105 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1974-0881-4d0f-b8da-0108e9f2493c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.197586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1974-0881-4d0f-b8da-0108e9f2493c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.198714 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b1974-0881-4d0f-b8da-0108e9f2493c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:59.205075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b1974-0881-4d0f-b8da-0108e9f2493c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:59.215962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb6e1-0d55-4c72-8969-a774900b72b8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:59.222468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1231/2467] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:05:59.227198 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b1974-0881-4d0f-b8da-0108e9f2493c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:59.228166 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a2fa2-bc5d-48c4-ba6e-9f156af1db8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:59.228870 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2fa2-bc5d-48c4-ba6e-9f156af1db8b service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.230068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2fa2-bc5d-48c4-ba6e-9f156af1db8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.230274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a2fa2-bc5d-48c4-ba6e-9f156af1db8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.241807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:05:59.244257 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a2fa2-bc5d-48c4-ba6e-9f156af1db8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:59.246921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a2fa2-bc5d-48c4-ba6e-9f156af1db8b service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:59.248965 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b1974-0881-4d0f-b8da-0108e9f2493c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:59.258648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c03b46-a0e6-47de-910e-68336ad2dce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:59.259402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03b46-a0e6-47de-910e-68336ad2dce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.259745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1237/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:59.259906 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03b46-a0e6-47de-910e-68336ad2dce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.260166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03b46-a0e6-47de-910e-68336ad2dce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.260978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c03b46-a0e6-47de-910e-68336ad2dce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:59.263657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c03b46-a0e6-47de-910e-68336ad2dce7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:59.283534 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1232/2469] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:05:59.286091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a2fa2-bc5d-48c4-ba6e-9f156af1db8b service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:59.316174 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a2fa2-bc5d-48c4-ba6e-9f156af1db8b service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:59.324032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb88f6e-7aa2-4901-87a9-1306ee29c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:59.325558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88f6e-7aa2-4901-87a9-1306ee29c239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.325558 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88f6e-7aa2-4901-87a9-1306ee29c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.326713 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88f6e-7aa2-4901-87a9-1306ee29c239 admin admin] PATH_INFO: `/v3/projects/d3285b88d6d3447bbf97437704be3e63/users/fd20a03ed6d34bea9a68f47e976365e3/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.350755 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c03b46-a0e6-47de-910e-68336ad2dce7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:59.364182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c03b46-a0e6-47de-910e-68336ad2dce7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:59.365794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb88f6e-7aa2-4901-87a9-1306ee29c239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3285b88d6d3447bbf97437704be3e63, user_id=fd20a03ed6d34bea9a68f47e976365e3, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:59.369258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:59.369867 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.370760 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.371043 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.372316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb88f6e-7aa2-4901-87a9-1306ee29c239 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:59.373292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:59.398556 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1238/2470] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:05:59 2022] PUT /identity/v3/projects/d3285b88d6d3447bbf97437704be3e63/users/fd20a03ed6d34bea9a68f47e976365e3/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:05:59.410342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac0ec-9b6b-41ea-ad81-af03545579ee None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.410950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac0ec-9b6b-41ea-ad81-af03545579ee None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.412702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac0ec-9b6b-41ea-ad81-af03545579ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.454839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fb9ac0ec-9b6b-41ea-ad81-af03545579ee None None] MFA Rules not processed for user `fd20a03ed6d34bea9a68f47e976365e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:05:59.456237 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fb9ac0ec-9b6b-41ea-ad81-af03545579ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:05:59.464141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:59.466020 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:59.478722 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1233/2471] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:05:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:05:59.595224 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1239/2472] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:05:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:05:59.596695 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:59.627551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9bfda-ce66-49f0-ab87-97324fc1102a service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:59.750257 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473961f2-53bd-4170-ab8f-1c0f8084d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:59.751258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473961f2-53bd-4170-ab8f-1c0f8084d8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.751850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473961f2-53bd-4170-ab8f-1c0f8084d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.752362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473961f2-53bd-4170-ab8f-1c0f8084d8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.754461 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473961f2-53bd-4170-ab8f-1c0f8084d8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:59.757717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473961f2-53bd-4170-ab8f-1c0f8084d8b5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:05:59.818231 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1234/2473] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:05:59 2022] POST /identity/v3/projects => generated 407 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:05:59.819350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac0ec-9b6b-41ea-ad81-af03545579ee None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:59.838798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac0ec-9b6b-41ea-ad81-af03545579ee None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:05:59.959838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473961f2-53bd-4170-ab8f-1c0f8084d8b5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:05:59.982756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f2bb-84c3-4c16-a4c0-7bd5322b881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:05:59.983259 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f2bb-84c3-4c16-a4c0-7bd5322b881a admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:05:59.983614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f2bb-84c3-4c16-a4c0-7bd5322b881a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:05:59.983963 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f2bb-84c3-4c16-a4c0-7bd5322b881a admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:05:59.984690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f2bb-84c3-4c16-a4c0-7bd5322b881a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:05:59.988980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f2bb-84c3-4c16-a4c0-7bd5322b881a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:00.028106 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1240/2474] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:05:59 2022] POST /identity/v3/users => generated 310 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:06:00.031740 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f2bb-84c3-4c16-a4c0-7bd5322b881a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:00.059858 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f2bb-84c3-4c16-a4c0-7bd5322b881a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:00.071468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7abe2e-75e3-4098-88bf-c5fbd7f52186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:00.072474 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7abe2e-75e3-4098-88bf-c5fbd7f52186 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.072756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7abe2e-75e3-4098-88bf-c5fbd7f52186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.073099 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7abe2e-75e3-4098-88bf-c5fbd7f52186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.074632 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7abe2e-75e3-4098-88bf-c5fbd7f52186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:00.076338 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7abe2e-75e3-4098-88bf-c5fbd7f52186 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:00.084633 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473961f2-53bd-4170-ab8f-1c0f8084d8b5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:00.089654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:00.090304 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.090630 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.091046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] PATH_INFO: `/v3/users/5ff8d3f378dc4192b124594ffd744b0a` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.092266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff8d3f378dc4192b124594ffd744b0a)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:00.094208 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:00.106927 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1241/2475] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:00.107829 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7abe2e-75e3-4098-88bf-c5fbd7f52186 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:00.119225 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:00.121098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7abe2e-75e3-4098-88bf-c5fbd7f52186 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:00.130061 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85f2ba-6a90-49f9-b084-0aea82ccc071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:00.131689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f2ba-6a90-49f9-b084-0aea82ccc071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.132150 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f2ba-6a90-49f9-b084-0aea82ccc071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.132635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f2ba-6a90-49f9-b084-0aea82ccc071 admin admin] PATH_INFO: `/v3/projects/4bce2cb33c4c40a2ae48abe43a4c4675/users/7d8f7954972c4c59af80321e5e74452e/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.154722 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85f2ba-6a90-49f9-b084-0aea82ccc071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bce2cb33c4c40a2ae48abe43a4c4675, user_id=7d8f7954972c4c59af80321e5e74452e, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:00.157919 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff8d3f378dc4192b124594ffd744b0a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:00.158077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85f2ba-6a90-49f9-b084-0aea82ccc071 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:00.177769 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff8d3f378dc4192b124594ffd744b0a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:00.178025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1242/2476] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:06:00 2022] PUT /identity/v3/projects/4bce2cb33c4c40a2ae48abe43a4c4675/users/7d8f7954972c4c59af80321e5e74452e/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:00.181902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85f2ba-6a90-49f9-b084-0aea82ccc071 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:00.187690 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff8d3f378dc4192b124594ffd744b0a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:00.188423 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff8d3f378dc4192b124594ffd744b0a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:00.192683 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:00.201111 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-452fb915-98c2-4326-8bb7-7f8b0e949dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff8d3f378dc4192b124594ffd744b0a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:00.211845 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1235/2477] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:05:59 2022] DELETE /identity/v3/users/5ff8d3f378dc4192b124594ffd744b0a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:06:00.217075 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efa541-d948-4cbf-80d2-ac559e5e45f2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.217494 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efa541-d948-4cbf-80d2-ac559e5e45f2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.219232 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efa541-d948-4cbf-80d2-ac559e5e45f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.251529 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c0efa541-d948-4cbf-80d2-ac559e5e45f2 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:00.252894 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c0efa541-d948-4cbf-80d2-ac559e5e45f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:00.273486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85f2ba-6a90-49f9-b084-0aea82ccc071 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:00.325426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1236/2478] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:00.335266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efa541-d948-4cbf-80d2-ac559e5e45f2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:00.337458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c0efa541-d948-4cbf-80d2-ac559e5e45f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:00.350792 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:00.351894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.352230 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.352639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.353294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:00.355776 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:00.372702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1243/2479] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:06:00.375408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:00.377502 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:00.392693 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964d979-151b-4c6b-9b13-3e63fa03de96 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:00.398253 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dff1f-db71-4225-bebf-23759c3fa687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:00.398984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dff1f-db71-4225-bebf-23759c3fa687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.399549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dff1f-db71-4225-bebf-23759c3fa687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.399549 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dff1f-db71-4225-bebf-23759c3fa687 admin admin] PATH_INFO: `/v3/projects/4bce2cb33c4c40a2ae48abe43a4c4675/users/7d8f7954972c4c59af80321e5e74452e/roles/2cefd0eca47446b7bfec36298dd71193` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.402264 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dff1f-db71-4225-bebf-23759c3fa687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bce2cb33c4c40a2ae48abe43a4c4675, user_id=7d8f7954972c4c59af80321e5e74452e, role_id=2cefd0eca47446b7bfec36298dd71193)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:00.405710 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dff1f-db71-4225-bebf-23759c3fa687 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:00.418780 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efa541-d948-4cbf-80d2-ac559e5e45f2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:00.431907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1244/2480] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:06:00 2022] PUT /identity/v3/projects/4bce2cb33c4c40a2ae48abe43a4c4675/users/7d8f7954972c4c59af80321e5e74452e/roles/2cefd0eca47446b7bfec36298dd71193 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:00.437503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10563-f69d-47f8-a0b3-7bbd446b1420 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.437798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10563-f69d-47f8-a0b3-7bbd446b1420 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.438082 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10563-f69d-47f8-a0b3-7bbd446b1420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.503641 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b5c10563-f69d-47f8-a0b3-7bbd446b1420 None None] MFA Rules not processed for user `7d8f7954972c4c59af80321e5e74452e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:00.505405 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b5c10563-f69d-47f8-a0b3-7bbd446b1420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:00.511654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:00.512553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.512919 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.513292 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.519387 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:00.633457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:00.636128 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:00.655348 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1237/2481] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:06:00.679114 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1245/2482] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:00 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:00.692467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:00.693967 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:00.797638 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3819-673d-4f34-8c29-81ee6a87cdd2 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:00.812765 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:00.813405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:00.813685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:00.813959 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:00.835777 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:00.839683 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:00.858069 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1238/2483] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:00 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:01.091263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10563-f69d-47f8-a0b3-7bbd446b1420 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:01.103293 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10563-f69d-47f8-a0b3-7bbd446b1420 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:01.108244 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:01.109113 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:01.109547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:01.110223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:01.112528 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:01.148827 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:01.250878 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:01.252347 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:01.266482 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1246/2484] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:01.609039 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:01.611535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:01.637632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90daef-579e-473c-910c-a9c4257bf735 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:01.652563 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:01.653156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:01.653431 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:01.654345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] PATH_INFO: `/v3/projects/df315359cd5349c7950cd41c6a54ecf8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:01.658657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=df315359cd5349c7950cd41c6a54ecf8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:01.660681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:01.778989 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df315359cd5349c7950cd41c6a54ecf8', 'request_id': 'req-c2dbf97e-7bcd-4eb8-9795-d18312531baf'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:01.809946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df315359cd5349c7950cd41c6a54ecf8', 'request_id': 'req-c2dbf97e-7bcd-4eb8-9795-d18312531baf'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:01.825044 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df315359cd5349c7950cd41c6a54ecf8', 'request_id': 'req-c2dbf97e-7bcd-4eb8-9795-d18312531baf'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:01.863285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] The token cache is being invalidate because project df315359cd5349c7950cd41c6a54ecf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:01.863579 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:01.873520 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:01.878291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1239/2485] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:01 2022] DELETE /identity/v3/projects/df315359cd5349c7950cd41c6a54ecf8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:01.883045 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:01.912406 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eea903-3be6-4bce-b530-b996c3e721ee service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:02.052250 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:02.052907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:02.053330 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:02.053614 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] PATH_INFO: `/v3/users/b34370a8c2724c8f8d6b88a8949be9cd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:02.055320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34370a8c2724c8f8d6b88a8949be9cd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:02.059884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:02.153278 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34370a8c2724c8f8d6b88a8949be9cd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:02.154042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34370a8c2724c8f8d6b88a8949be9cd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:02.176036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34370a8c2724c8f8d6b88a8949be9cd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:02.195089 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34370a8c2724c8f8d6b88a8949be9cd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:02.195835 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-880729fa-71cf-4ceb-811f-8b00e21db292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34370a8c2724c8f8d6b88a8949be9cd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:02.261754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1247/2486] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:06:01 2022] DELETE /identity/v3/users/b34370a8c2724c8f8d6b88a8949be9cd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:02.785611 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:02.787649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:02.809244 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf97e-7bcd-4eb8-9795-d18312531baf admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:02.861668 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:02.906657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:02.907553 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:02.907832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:02.908107 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] PATH_INFO: `/v3/projects/a7baa2d9b73c4874b117f75e2d1d6b1c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:02.909253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7baa2d9b73c4874b117f75e2d1d6b1c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:02.911207 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:02.974978 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7baa2d9b73c4874b117f75e2d1d6b1c', 'request_id': 'req-1b87765b-b7db-4757-9de4-9fcd3136e2f0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:02.987346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7baa2d9b73c4874b117f75e2d1d6b1c', 'request_id': 'req-1b87765b-b7db-4757-9de4-9fcd3136e2f0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:03.006166 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7baa2d9b73c4874b117f75e2d1d6b1c', 'request_id': 'req-1b87765b-b7db-4757-9de4-9fcd3136e2f0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:03.049171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] The token cache is being invalidate because project a7baa2d9b73c4874b117f75e2d1d6b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:03.049896 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:03.051146 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1b87765b-b7db-4757-9de4-9fcd3136e2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:03.054572 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1240/2487] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:02 2022] DELETE /identity/v3/projects/a7baa2d9b73c4874b117f75e2d1d6b1c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:03.058664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab2ac3-5ce5-47ae-a36e-03c8495d68b6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.059107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab2ac3-5ce5-47ae-a36e-03c8495d68b6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.059219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab2ac3-5ce5-47ae-a36e-03c8495d68b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.087560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ffab2ac3-5ce5-47ae-a36e-03c8495d68b6 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:03.090006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ffab2ac3-5ce5-47ae-a36e-03c8495d68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:03.164141 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:03.217721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1248/2488] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:06:03.228704 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ff9ab-fd0b-4f35-b5c4-cdc65cbf99f1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.228913 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ff9ab-fd0b-4f35-b5c4-cdc65cbf99f1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.229862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ff9ab-fd0b-4f35-b5c4-cdc65cbf99f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.265259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-511ff9ab-fd0b-4f35-b5c4-cdc65cbf99f1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:03.268263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-511ff9ab-fd0b-4f35-b5c4-cdc65cbf99f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:03.292886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1241/2489] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:03.295760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab2ac3-5ce5-47ae-a36e-03c8495d68b6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:03.313229 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab2ac3-5ce5-47ae-a36e-03c8495d68b6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:03.320109 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38dbb2-1a00-4940-99eb-c4b6e1a0274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:03.321086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38dbb2-1a00-4940-99eb-c4b6e1a0274c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.321708 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38dbb2-1a00-4940-99eb-c4b6e1a0274c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.322232 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38dbb2-1a00-4940-99eb-c4b6e1a0274c admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.323702 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38dbb2-1a00-4940-99eb-c4b6e1a0274c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:06:03.324316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38dbb2-1a00-4940-99eb-c4b6e1a0274c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:03.328286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38dbb2-1a00-4940-99eb-c4b6e1a0274c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:03.354626 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1249/2490] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:06:03.356562 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ff9ab-fd0b-4f35-b5c4-cdc65cbf99f1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:03.367764 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ff9ab-fd0b-4f35-b5c4-cdc65cbf99f1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:03.379523 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c880a0-d37d-4aa5-a462-d1042fbb77f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:03.380223 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c880a0-d37d-4aa5-a462-d1042fbb77f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.380500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c880a0-d37d-4aa5-a462-d1042fbb77f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.380833 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c880a0-d37d-4aa5-a462-d1042fbb77f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.381558 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c880a0-d37d-4aa5-a462-d1042fbb77f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:03.383519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c880a0-d37d-4aa5-a462-d1042fbb77f9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:03.411684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183304d-7dbc-4f65-9d5c-a79004caf5e3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.412265 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183304d-7dbc-4f65-9d5c-a79004caf5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.413086 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183304d-7dbc-4f65-9d5c-a79004caf5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.423531 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1242/2491] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:06:03 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:06:03.427544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c880a0-d37d-4aa5-a462-d1042fbb77f9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:03.466457 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a183304d-7dbc-4f65-9d5c-a79004caf5e3 None None] MFA Rules not processed for user `7060db7cf84d491ba49034fbdfbdad1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:03.467798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a183304d-7dbc-4f65-9d5c-a79004caf5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:03.528412 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c880a0-d37d-4aa5-a462-d1042fbb77f9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:03.534711 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c7971-0fac-4ef7-bd2d-519021e5d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:03.535516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7971-0fac-4ef7-bd2d-519021e5d87a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.536197 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7971-0fac-4ef7-bd2d-519021e5d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.536487 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7971-0fac-4ef7-bd2d-519021e5d87a admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.537674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c7971-0fac-4ef7-bd2d-519021e5d87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:03.539667 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c7971-0fac-4ef7-bd2d-519021e5d87a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:03.547660 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1250/2492] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:03.561443 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183304d-7dbc-4f65-9d5c-a79004caf5e3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:03.563060 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a183304d-7dbc-4f65-9d5c-a79004caf5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:03.573602 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1243/2493] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:06:03 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:06:03.580646 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c7971-0fac-4ef7-bd2d-519021e5d87a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:03.592235 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c7971-0fac-4ef7-bd2d-519021e5d87a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:03.599556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe5f0-4a06-4de8-a008-d705dbef5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:03.600326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe5f0-4a06-4de8-a008-d705dbef5c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.600608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe5f0-4a06-4de8-a008-d705dbef5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.600884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe5f0-4a06-4de8-a008-d705dbef5c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.601736 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe5f0-4a06-4de8-a008-d705dbef5c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:03.603852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe5f0-4a06-4de8-a008-d705dbef5c80 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:03.619331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1244/2494] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:03.624269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe5f0-4a06-4de8-a008-d705dbef5c80 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:03.637745 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe5f0-4a06-4de8-a008-d705dbef5c80 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:03.646150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55630cab-3f74-490e-8e6e-031d0c0c27b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:03.647445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55630cab-3f74-490e-8e6e-031d0c0c27b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.647605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183304d-7dbc-4f65-9d5c-a79004caf5e3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:03.648457 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55630cab-3f74-490e-8e6e-031d0c0c27b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.648996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55630cab-3f74-490e-8e6e-031d0c0c27b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.650772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55630cab-3f74-490e-8e6e-031d0c0c27b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:03.652754 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ede14ff816494505b20faba615bc5026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:03.653540 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55630cab-3f74-490e-8e6e-031d0c0c27b1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:03.653682 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.653843 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.654122 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.656026 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:03.656728 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:03.672818 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1245/2495] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 17:06:03.673796 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55630cab-3f74-490e-8e6e-031d0c0c27b1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:03.686568 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55630cab-3f74-490e-8e6e-031d0c0c27b1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:03.692126 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0555997-734b-4c4b-90f2-c4ed8651ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:03.692785 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555997-734b-4c4b-90f2-c4ed8651ec5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.693076 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555997-734b-4c4b-90f2-c4ed8651ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.693393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555997-734b-4c4b-90f2-c4ed8651ec5b admin admin] PATH_INFO: `/v3/projects/ab9b981549f64f52b3e437dc30dcacc8/users/3ed5a5f68eaf4d38bb8317bfde73a178/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.713941 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0555997-734b-4c4b-90f2-c4ed8651ec5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9b981549f64f52b3e437dc30dcacc8, user_id=3ed5a5f68eaf4d38bb8317bfde73a178, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:03.716844 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0555997-734b-4c4b-90f2-c4ed8651ec5b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:03.723717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:03.725185 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:03.734486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1246/2496] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:06:03 2022] PUT /identity/v3/projects/ab9b981549f64f52b3e437dc30dcacc8/users/3ed5a5f68eaf4d38bb8317bfde73a178/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:03.736764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1251/2497] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:06:03.745434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d519-6ead-478a-8500-22f759d0c017 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.745824 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d519-6ead-478a-8500-22f759d0c017 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.746272 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d519-6ead-478a-8500-22f759d0c017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.775943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2d65d519-6ead-478a-8500-22f759d0c017 None None] MFA Rules not processed for user `3ed5a5f68eaf4d38bb8317bfde73a178`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:03.777996 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2d65d519-6ead-478a-8500-22f759d0c017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:03.861434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1247/2498] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:03.875809 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:03.877629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:03.894644 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:03.895329 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffedce2-71ac-42f5-a23b-6a4867892f74 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:03.895720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffedce2-71ac-42f5-a23b-6a4867892f74 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:03.896275 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffedce2-71ac-42f5-a23b-6a4867892f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:03.919995 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9ffedce2-71ac-42f5-a23b-6a4867892f74 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:03.921263 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9ffedce2-71ac-42f5-a23b-6a4867892f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:03.957067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e11b-9029-41b7-b158-f4c57a55fd50 service glance] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:03.980171 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1248/2499] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:06:04.014721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:04.015351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:04.015635 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:04.015938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:04.024798 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:04.026900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:04.029364 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffedce2-71ac-42f5-a23b-6a4867892f74 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:04.030790 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9ffedce2-71ac-42f5-a23b-6a4867892f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:04.036194 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1252/2500] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:04.104842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffedce2-71ac-42f5-a23b-6a4867892f74 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:04.110502 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825f00c-bd28-40c9-adeb-d7ffba044b74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:04.111155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825f00c-bd28-40c9-adeb-d7ffba044b74 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:04.111723 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825f00c-bd28-40c9-adeb-d7ffba044b74 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:04.112005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825f00c-bd28-40c9-adeb-d7ffba044b74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:04.122669 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825f00c-bd28-40c9-adeb-d7ffba044b74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:04.124277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825f00c-bd28-40c9-adeb-d7ffba044b74 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:04.128472 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:04.136088 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1249/2501] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:06:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 17:06:07.604757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:07.606472 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:07.725389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ead17-bcbc-42c8-882b-4f9365304dc8 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:07.730231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:07.730982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:07.731451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:07.731799 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] PATH_INFO: `/v3/users/fd20a03ed6d34bea9a68f47e976365e3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:07.733137 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd20a03ed6d34bea9a68f47e976365e3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:07.738064 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:07.804784 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd20a03ed6d34bea9a68f47e976365e3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:07.805717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd20a03ed6d34bea9a68f47e976365e3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:07.816417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd20a03ed6d34bea9a68f47e976365e3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:07.827488 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:07.834456 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd20a03ed6d34bea9a68f47e976365e3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:07.835658 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd20a03ed6d34bea9a68f47e976365e3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:07.855769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1253/2502] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:06:07 2022] DELETE /identity/v3/users/fd20a03ed6d34bea9a68f47e976365e3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:07.860479 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f04a13-9a9c-41c3-a019-f7a67338ac7d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:07.860997 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f04a13-9a9c-41c3-a019-f7a67338ac7d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:07.861106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f04a13-9a9c-41c3-a019-f7a67338ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:07.890221 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-92f04a13-9a9c-41c3-a019-f7a67338ac7d None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:07.891484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-92f04a13-9a9c-41c3-a019-f7a67338ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:07.978331 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1250/2503] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:07.989151 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:07.990813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:08.078890 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003f8f4-a67f-4b63-8673-818f1885e3e9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:08.083846 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3c09-88f1-4e5d-b514-337887b915fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:08.084545 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3c09-88f1-4e5d-b514-337887b915fc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:08.085031 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3c09-88f1-4e5d-b514-337887b915fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:08.085355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3c09-88f1-4e5d-b514-337887b915fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:08.108076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3c09-88f1-4e5d-b514-337887b915fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:08.109684 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3c09-88f1-4e5d-b514-337887b915fc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:08.129273 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1254/2504] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:08.531687 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f04a13-9a9c-41c3-a019-f7a67338ac7d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:08.533720 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-92f04a13-9a9c-41c3-a019-f7a67338ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:08.554618 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f04a13-9a9c-41c3-a019-f7a67338ac7d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:08.560830 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:08.561410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:08.561692 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:08.562052 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] PATH_INFO: `/v3/projects/d3285b88d6d3447bbf97437704be3e63` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:08.563454 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3285b88d6d3447bbf97437704be3e63)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:08.566591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:08.650389 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3285b88d6d3447bbf97437704be3e63', 'request_id': 'req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.658247 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3285b88d6d3447bbf97437704be3e63', 'request_id': 'req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.665202 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3285b88d6d3447bbf97437704be3e63', 'request_id': 'req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.683074 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] The token cache is being invalidate because project d3285b88d6d3447bbf97437704be3e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:08.683405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.684168 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.686950 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1251/2505] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:08 2022] DELETE /identity/v3/projects/d3285b88d6d3447bbf97437704be3e63 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:08.689984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3c09-88f1-4e5d-b514-337887b915fc service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:08.701539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3c09-88f1-4e5d-b514-337887b915fc service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:08.772576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:08.773339 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:08.773716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:08.773945 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] PATH_INFO: `/v3/users/7d8f7954972c4c59af80321e5e74452e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:08.775131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8f7954972c4c59af80321e5e74452e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:08.777239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:08.840155 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8f7954972c4c59af80321e5e74452e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.840883 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8f7954972c4c59af80321e5e74452e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.850907 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8f7954972c4c59af80321e5e74452e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.868523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8f7954972c4c59af80321e5e74452e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.870053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-f4ebb3d9-1cc9-4819-a77e-baab18b3a2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8f7954972c4c59af80321e5e74452e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:08.884995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1255/2506] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:06:08 2022] DELETE /identity/v3/users/7d8f7954972c4c59af80321e5e74452e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:09.272351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:09.274303 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:09.303156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c9ca-e49b-40ae-935a-4e08882ca62d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:09.386437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:09.387253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:09.387601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:09.387947 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] PATH_INFO: `/v3/projects/4bce2cb33c4c40a2ae48abe43a4c4675` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:09.389639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bce2cb33c4c40a2ae48abe43a4c4675)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:09.391386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:09.430468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:09.475862 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bce2cb33c4c40a2ae48abe43a4c4675', 'request_id': 'req-e5fe13d5-1c86-4df5-a2fe-7797d3946632'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:09.483029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bce2cb33c4c40a2ae48abe43a4c4675', 'request_id': 'req-e5fe13d5-1c86-4df5-a2fe-7797d3946632'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:09.490802 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bce2cb33c4c40a2ae48abe43a4c4675', 'request_id': 'req-e5fe13d5-1c86-4df5-a2fe-7797d3946632'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:09.521898 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] The token cache is being invalidate because project 4bce2cb33c4c40a2ae48abe43a4c4675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:09.522887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:09.528136 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e5fe13d5-1c86-4df5-a2fe-7797d3946632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:09.542849 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1252/2507] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:09 2022] DELETE /identity/v3/projects/4bce2cb33c4c40a2ae48abe43a4c4675 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:09.547399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff1cb-2e32-453e-8b12-b9050cdeeb68 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:09.547984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff1cb-2e32-453e-8b12-b9050cdeeb68 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:09.548468 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff1cb-2e32-453e-8b12-b9050cdeeb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:09.567715 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:09.577368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2baff1cb-2e32-453e-8b12-b9050cdeeb68 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:09.580117 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2baff1cb-2e32-453e-8b12-b9050cdeeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:09.671023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1256/2508] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:09.681480 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57894f6c-7b5d-4858-8086-4136dc7a23ce None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:09.682311 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57894f6c-7b5d-4858-8086-4136dc7a23ce None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:09.682882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57894f6c-7b5d-4858-8086-4136dc7a23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:09.725018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-57894f6c-7b5d-4858-8086-4136dc7a23ce None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:09.726345 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-57894f6c-7b5d-4858-8086-4136dc7a23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:09.743595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1253/2509] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:09.745999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baff1cb-2e32-453e-8b12-b9050cdeeb68 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:09.768217 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baff1cb-2e32-453e-8b12-b9050cdeeb68 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:09.777583 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:09.778384 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:09.778725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:09.779020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:09.779670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:06:09.780023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:09.782554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:09.799188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1257/2510] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:06:09.803143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57894f6c-7b5d-4858-8086-4136dc7a23ce None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:09.813886 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57894f6c-7b5d-4858-8086-4136dc7a23ce None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:09.821096 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080248f-e09d-4131-9724-cdf2b4a6fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:09.821838 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080248f-e09d-4131-9724-cdf2b4a6fbbf admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:09.822186 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080248f-e09d-4131-9724-cdf2b4a6fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:09.823178 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080248f-e09d-4131-9724-cdf2b4a6fbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:09.823940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080248f-e09d-4131-9724-cdf2b4a6fbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:09.826233 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080248f-e09d-4131-9724-cdf2b4a6fbbf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:09.868155 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1254/2511] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:06:09 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:06:09.874946 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:09.889266 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff451d-2982-4a49-8982-fea867b04c26 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:09.969437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3541-26b8-440f-8ba1-d30f008861be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:09.970041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3541-26b8-440f-8ba1-d30f008861be admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:09.970320 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3541-26b8-440f-8ba1-d30f008861be admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:09.970625 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3541-26b8-440f-8ba1-d30f008861be admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:09.971316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3541-26b8-440f-8ba1-d30f008861be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:09.973331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3541-26b8-440f-8ba1-d30f008861be admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:10.002351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1258/2512] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:06:09 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:06:10.007793 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080248f-e09d-4131-9724-cdf2b4a6fbbf admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:10.019288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080248f-e09d-4131-9724-cdf2b4a6fbbf admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:10.024009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ed877-d6c7-4053-a255-a1dc2a6afb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:10.024658 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ed877-d6c7-4053-a255-a1dc2a6afb80 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:10.024942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ed877-d6c7-4053-a255-a1dc2a6afb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:10.025215 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ed877-d6c7-4053-a255-a1dc2a6afb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:10.026557 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ed877-d6c7-4053-a255-a1dc2a6afb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:10.028347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ed877-d6c7-4053-a255-a1dc2a6afb80 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:10.042756 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1255/2513] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:10.043146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3541-26b8-440f-8ba1-d30f008861be admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:10.053747 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3541-26b8-440f-8ba1-d30f008861be admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:10.060802 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf623aaa-b34f-412a-bcb6-cd03c007232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:10.061412 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf623aaa-b34f-412a-bcb6-cd03c007232f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:10.061704 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf623aaa-b34f-412a-bcb6-cd03c007232f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:10.061957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf623aaa-b34f-412a-bcb6-cd03c007232f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:10.062633 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf623aaa-b34f-412a-bcb6-cd03c007232f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:10.064223 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf623aaa-b34f-412a-bcb6-cd03c007232f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:10.080854 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1259/2514] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:10.084955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ed877-d6c7-4053-a255-a1dc2a6afb80 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:10.097645 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ed877-d6c7-4053-a255-a1dc2a6afb80 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:10.103248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:10.104010 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:10.104305 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:10.104750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] PATH_INFO: `/v3/projects/b2a45279910440108293bd6a1b016d34/users/994a099bd0b24c5d831701584434e365/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:10.121547 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a45279910440108293bd6a1b016d34, user_id=994a099bd0b24c5d831701584434e365, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:10.124238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:10.139952 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1256/2515] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:06:10 2022] PUT /identity/v3/projects/b2a45279910440108293bd6a1b016d34/users/994a099bd0b24c5d831701584434e365/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:10.152251 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bf1a-a88d-4ad1-9d31-c5fbf34a33b6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:10.152585 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bf1a-a88d-4ad1-9d31-c5fbf34a33b6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:10.152863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bf1a-a88d-4ad1-9d31-c5fbf34a33b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:10.190875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e254bf1a-a88d-4ad1-9d31-c5fbf34a33b6 None None] MFA Rules not processed for user `994a099bd0b24c5d831701584434e365`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:10.194891 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e254bf1a-a88d-4ad1-9d31-c5fbf34a33b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:10.278046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1260/2516] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:10.292999 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:10.294865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:10.366393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e820f9-ff25-41d2-94aa-e5a5ef47368c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:10.370248 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee5134-fa0e-483d-9b42-eacbf970b961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:10.372447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee5134-fa0e-483d-9b42-eacbf970b961 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:10.372887 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee5134-fa0e-483d-9b42-eacbf970b961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:10.373234 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee5134-fa0e-483d-9b42-eacbf970b961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:10.383048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee5134-fa0e-483d-9b42-eacbf970b961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:10.384570 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee5134-fa0e-483d-9b42-eacbf970b961 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:10.396424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1257/2517] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:10.420839 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254bf1a-a88d-4ad1-9d31-c5fbf34a33b6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:10.425222 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:10.500539 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254bf1a-a88d-4ad1-9d31-c5fbf34a33b6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:10.510808 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:10.511650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:10.512001 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:10.512345 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] PATH_INFO: `/v3/users/994a099bd0b24c5d831701584434e365` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:10.513577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=994a099bd0b24c5d831701584434e365)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:10.515701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:10.573018 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994a099bd0b24c5d831701584434e365'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:10.574000 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994a099bd0b24c5d831701584434e365'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:10.584342 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994a099bd0b24c5d831701584434e365'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:10.608542 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994a099bd0b24c5d831701584434e365'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:10.609348 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994a099bd0b24c5d831701584434e365'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:10.629284 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1261/2518] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:06:10 2022] DELETE /identity/v3/users/994a099bd0b24c5d831701584434e365 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:10.633057 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51758827-bead-4446-8adc-e818d0565784 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:10.633365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51758827-bead-4446-8adc-e818d0565784 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:10.633615 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51758827-bead-4446-8adc-e818d0565784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:10.656365 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-51758827-bead-4446-8adc-e818d0565784 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:10.657616 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-51758827-bead-4446-8adc-e818d0565784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:10.719649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:10.742632 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1258/2519] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:10.751146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:10.752812 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:10.845361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdedd2-d32e-490b-a12e-cacdf208b7fe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:10.845361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441b868-543f-4588-afae-662d44489371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:10.845361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b868-543f-4588-afae-662d44489371 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:10.845361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b868-543f-4588-afae-662d44489371 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:10.846374 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b868-543f-4588-afae-662d44489371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:10.851816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441b868-543f-4588-afae-662d44489371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:10.853382 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441b868-543f-4588-afae-662d44489371 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:10.863685 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1262/2520] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:06:11.269017 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51758827-bead-4446-8adc-e818d0565784 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:11.270971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-51758827-bead-4446-8adc-e818d0565784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:11.325288 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51758827-bead-4446-8adc-e818d0565784 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:11.330261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:11.331079 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.331390 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.332100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] PATH_INFO: `/v3/projects/b2a45279910440108293bd6a1b016d34` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.334601 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a45279910440108293bd6a1b016d34)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:11.335453 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:11.393067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a45279910440108293bd6a1b016d34', 'request_id': 'req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:11.404320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a45279910440108293bd6a1b016d34', 'request_id': 'req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:11.411349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a45279910440108293bd6a1b016d34', 'request_id': 'req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:11.427438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] The token cache is being invalidate because project b2a45279910440108293bd6a1b016d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:11.427750 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:11.428372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b2980a39-24f7-4b5a-8fb8-598eb4abb53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:11.430185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1259/2521] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:11 2022] DELETE /identity/v3/projects/b2a45279910440108293bd6a1b016d34 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:11.435537 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46018c-25ce-482c-9728-b9f8a0ca0da1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.435822 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46018c-25ce-482c-9728-b9f8a0ca0da1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.436094 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46018c-25ce-482c-9728-b9f8a0ca0da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.461179 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1f46018c-25ce-482c-9728-b9f8a0ca0da1 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:11.462986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f46018c-25ce-482c-9728-b9f8a0ca0da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:11.486255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:11.538165 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1263/2522] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:11.547336 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65259fc-1b0f-4e82-a16d-919f605431cc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.548038 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65259fc-1b0f-4e82-a16d-919f605431cc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.548261 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65259fc-1b0f-4e82-a16d-919f605431cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.569445 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e65259fc-1b0f-4e82-a16d-919f605431cc None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:11.570725 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e65259fc-1b0f-4e82-a16d-919f605431cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:11.582266 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1260/2523] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:11.583475 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46018c-25ce-482c-9728-b9f8a0ca0da1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:11.594092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46018c-25ce-482c-9728-b9f8a0ca0da1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:11.598695 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:11.599304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.599586 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.599861 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.600579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:06:11.600886 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:11.602486 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:11.621590 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1264/2524] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:06:11.622719 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65259fc-1b0f-4e82-a16d-919f605431cc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:11.635061 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65259fc-1b0f-4e82-a16d-919f605431cc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:11.639932 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dbc51-6017-45e9-80c5-5024370f8d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:11.640546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dbc51-6017-45e9-80c5-5024370f8d98 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.640819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dbc51-6017-45e9-80c5-5024370f8d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.641086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dbc51-6017-45e9-80c5-5024370f8d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.641775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dbc51-6017-45e9-80c5-5024370f8d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:11.643680 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dbc51-6017-45e9-80c5-5024370f8d98 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:11.678911 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1261/2525] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:06:11 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:06:11.683760 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:11.696120 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc8f8-42d4-4b8e-981c-aee14fddf5e0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:11.766751 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be3f6-7aa9-49ba-aa62-c47f34c3b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:11.767447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be3f6-7aa9-49ba-aa62-c47f34c3b174 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.767703 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be3f6-7aa9-49ba-aa62-c47f34c3b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.767984 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be3f6-7aa9-49ba-aa62-c47f34c3b174 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.768677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be3f6-7aa9-49ba-aa62-c47f34c3b174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:11.770639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be3f6-7aa9-49ba-aa62-c47f34c3b174 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:11.794404 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1265/2526] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:06:11 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:06:11.798361 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dbc51-6017-45e9-80c5-5024370f8d98 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:11.810842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dbc51-6017-45e9-80c5-5024370f8d98 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:11.816607 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9a37-03af-4693-935b-8cb5675474fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:11.817414 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9a37-03af-4693-935b-8cb5675474fb admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.818548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9a37-03af-4693-935b-8cb5675474fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.818548 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9a37-03af-4693-935b-8cb5675474fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.818758 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd9a37-03af-4693-935b-8cb5675474fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:11.820411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd9a37-03af-4693-935b-8cb5675474fb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:11.832243 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1262/2527] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:11.835954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be3f6-7aa9-49ba-aa62-c47f34c3b174 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:11.847162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be3f6-7aa9-49ba-aa62-c47f34c3b174 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:11.854381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779b31a-00a8-4494-bc71-d629ff7f8503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:11.855076 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b31a-00a8-4494-bc71-d629ff7f8503 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.855447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b31a-00a8-4494-bc71-d629ff7f8503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.857688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b31a-00a8-4494-bc71-d629ff7f8503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.857688 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779b31a-00a8-4494-bc71-d629ff7f8503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:11.858178 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779b31a-00a8-4494-bc71-d629ff7f8503 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:11.870937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1266/2528] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:11.874792 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9a37-03af-4693-935b-8cb5675474fb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:11.891823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9a37-03af-4693-935b-8cb5675474fb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:11.898087 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:11.899199 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:11.899477 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:11.899910 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] PATH_INFO: `/v3/projects/dba01ab407314611a2a53ed6f163a204/users/0b828b4bcd9c4915846b36e45f1bf499/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:11.917925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba01ab407314611a2a53ed6f163a204, user_id=0b828b4bcd9c4915846b36e45f1bf499, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:11.920771 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:11.937518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1263/2529] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:06:11 2022] PUT /identity/v3/projects/dba01ab407314611a2a53ed6f163a204/users/0b828b4bcd9c4915846b36e45f1bf499/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:12.008569 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67373a54-6447-4fcf-b53f-a511916f848c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:12.008837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67373a54-6447-4fcf-b53f-a511916f848c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:12.009115 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67373a54-6447-4fcf-b53f-a511916f848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:12.038363 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-67373a54-6447-4fcf-b53f-a511916f848c None None] MFA Rules not processed for user `0b828b4bcd9c4915846b36e45f1bf499`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:12.039757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67373a54-6447-4fcf-b53f-a511916f848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:12.123087 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1267/2530] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:12.133507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:12.135942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:12.238106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3faf6b-55d4-4d65-82ce-49b8ac34a879 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:12.242585 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ede14ff816494505b20faba615bc5026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:12.246595 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:12.247051 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:12.247424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:12.257120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:12.258969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:12.281499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1264/2531] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:14.496741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc24a4-7cc2-4248-b3f3-e68bbb6ffeb5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:14.497255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc24a4-7cc2-4248-b3f3-e68bbb6ffeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:14.497485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc24a4-7cc2-4248-b3f3-e68bbb6ffeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:14.517667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0cdc24a4-7cc2-4248-b3f3-e68bbb6ffeb5 None None] MFA Rules not processed for user `04a1c69123f248399e57b4f77ebf61bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:14.519046 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0cdc24a4-7cc2-4248-b3f3-e68bbb6ffeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:14.532485 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:14.580304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1268/2532] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:14.842002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:14.843358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:14.857220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:14.902100 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbaa459-2429-4e40-bbc7-d9eead051af4 service glance] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:14.905746 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd6bc0-b3a3-44b6-b7e9-79e520e03cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:14.906351 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd6bc0-b3a3-44b6-b7e9-79e520e03cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:14.906675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd6bc0-b3a3-44b6-b7e9-79e520e03cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:14.906953 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd6bc0-b3a3-44b6-b7e9-79e520e03cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:14.908673 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a2dd6bc0-b3a3-44b6-b7e9-79e520e03cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:14.918621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd6bc0-b3a3-44b6-b7e9-79e520e03cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:14.920121 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd6bc0-b3a3-44b6-b7e9-79e520e03cc0 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:14.929521 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1265/2533] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:16.377811 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc24a4-7cc2-4248-b3f3-e68bbb6ffeb5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:16.379605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0cdc24a4-7cc2-4248-b3f3-e68bbb6ffeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:16.471756 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc24a4-7cc2-4248-b3f3-e68bbb6ffeb5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:16.477399 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:16.478042 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:16.478325 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:16.478664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] PATH_INFO: `/v3/users/3ed5a5f68eaf4d38bb8317bfde73a178` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:16.479981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed5a5f68eaf4d38bb8317bfde73a178)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:16.482003 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:16.539678 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed5a5f68eaf4d38bb8317bfde73a178'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:16.540355 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed5a5f68eaf4d38bb8317bfde73a178'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:16.548267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed5a5f68eaf4d38bb8317bfde73a178'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:16.568701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed5a5f68eaf4d38bb8317bfde73a178'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:16.570200 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed5a5f68eaf4d38bb8317bfde73a178'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:16.586022 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1269/2534] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:06:16 2022] DELETE /identity/v3/users/3ed5a5f68eaf4d38bb8317bfde73a178 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:16.591823 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f354c69-018c-45f1-9278-ebd6495c69f5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:16.592326 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f354c69-018c-45f1-9278-ebd6495c69f5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:16.592428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f354c69-018c-45f1-9278-ebd6495c69f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:16.630509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6f354c69-018c-45f1-9278-ebd6495c69f5 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:16.631775 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6f354c69-018c-45f1-9278-ebd6495c69f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:16.694411 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1266/2535] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:16.705819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:16.707650 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:16.760884 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:16.776483 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace802d3-887b-4774-8b8c-5502097b916b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:16.781841 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:16.782547 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:16.782863 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:16.783201 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:16.786631 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d43de-4a16-4704-ad50-cd3e64197573 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:16.786921 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d43de-4a16-4704-ad50-cd3e64197573 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:16.787195 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d43de-4a16-4704-ad50-cd3e64197573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:16.793536 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:16.795077 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:16.808657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c35d43de-4a16-4704-ad50-cd3e64197573 None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:16.809893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c35d43de-4a16-4704-ad50-cd3e64197573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:16.810794 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1270/2536] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:16.889631 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1267/2537] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Oct 10 17:06:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:16.890725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:16.892358 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:16.969779 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33c6be-4716-4cfa-b40f-7977be184ffd service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:16.976518 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a380b6-af19-4b62-bcfa-535ff21f5d7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:16.976518 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a380b6-af19-4b62-bcfa-535ff21f5d7f service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:16.976518 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a380b6-af19-4b62-bcfa-535ff21f5d7f service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:16.976518 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a380b6-af19-4b62-bcfa-535ff21f5d7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:16.986416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a380b6-af19-4b62-bcfa-535ff21f5d7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:16.988246 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a380b6-af19-4b62-bcfa-535ff21f5d7f service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:17.010571 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1271/2538] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:06:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:06:17.237223 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d43de-4a16-4704-ad50-cd3e64197573 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:17.238770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c35d43de-4a16-4704-ad50-cd3e64197573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:17.265114 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d43de-4a16-4704-ad50-cd3e64197573 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:17.271080 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:17.272122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:17.286126 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:17.286278 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] PATH_INFO: `/v3/projects/ab9b981549f64f52b3e437dc30dcacc8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:17.288767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9b981549f64f52b3e437dc30dcacc8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:17.290772 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:17.420219 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9b981549f64f52b3e437dc30dcacc8', 'request_id': 'req-62e07ec2-7715-49a5-8f0d-21d34702e50f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:17.430675 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9b981549f64f52b3e437dc30dcacc8', 'request_id': 'req-62e07ec2-7715-49a5-8f0d-21d34702e50f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:17.440729 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:17.457591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9b981549f64f52b3e437dc30dcacc8', 'request_id': 'req-62e07ec2-7715-49a5-8f0d-21d34702e50f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:17.481806 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] The token cache is being invalidate because project ab9b981549f64f52b3e437dc30dcacc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:17.482386 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:17.483544 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-62e07ec2-7715-49a5-8f0d-21d34702e50f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:17.485342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1268/2539] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:17 2022] DELETE /identity/v3/projects/ab9b981549f64f52b3e437dc30dcacc8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:17.501256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf174a-3e66-487b-a820-03cd251fc50f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:17.501256 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf174a-3e66-487b-a820-03cd251fc50f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:17.502219 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf174a-3e66-487b-a820-03cd251fc50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:17.526679 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cccf174a-3e66-487b-a820-03cd251fc50f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:17.527835 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cccf174a-3e66-487b-a820-03cd251fc50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:17.643032 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1272/2540] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:17.644707 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28689-dd9e-4b0d-8ba3-046f6610d619 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:17.645176 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28689-dd9e-4b0d-8ba3-046f6610d619 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:17.645576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28689-dd9e-4b0d-8ba3-046f6610d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:17.674754 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b4d28689-dd9e-4b0d-8ba3-046f6610d619 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:17.676134 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b4d28689-dd9e-4b0d-8ba3-046f6610d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:17.702623 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1269/2541] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:06:17.706987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf174a-3e66-487b-a820-03cd251fc50f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:17.725543 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf174a-3e66-487b-a820-03cd251fc50f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:17.740654 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:17.741356 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:17.741701 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:17.742050 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:17.742938 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:06:17.743340 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:17.745969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:17.780819 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d28689-dd9e-4b0d-8ba3-046f6610d619 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:17.785694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1273/2542] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:06:17.793766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d28689-dd9e-4b0d-8ba3-046f6610d619 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:17.808205 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2861-2e70-4306-939d-e1b5f6e1377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:17.808923 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2861-2e70-4306-939d-e1b5f6e1377e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:17.809314 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2861-2e70-4306-939d-e1b5f6e1377e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:17.809718 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2861-2e70-4306-939d-e1b5f6e1377e admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:17.812416 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2861-2e70-4306-939d-e1b5f6e1377e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:17.814672 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2861-2e70-4306-939d-e1b5f6e1377e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:17.864220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1270/2543] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:06:17 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:06:17.868600 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:17.881276 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaa609-15ad-4cb1-a994-bd76a68f58d5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:17.990334 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0b20-0f53-4507-b4c1-7c033861641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:17.990999 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0b20-0f53-4507-b4c1-7c033861641b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:17.991281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0b20-0f53-4507-b4c1-7c033861641b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:17.991564 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0b20-0f53-4507-b4c1-7c033861641b admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:17.992218 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af0b20-0f53-4507-b4c1-7c033861641b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:17.994323 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af0b20-0f53-4507-b4c1-7c033861641b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:18.010238 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:18.027311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1274/2544] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:06:17 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:06:18.031528 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2861-2e70-4306-939d-e1b5f6e1377e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:18.043398 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2861-2e70-4306-939d-e1b5f6e1377e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:18.048220 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f644f-b59f-4c78-8ff1-57e2178be390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:18.048840 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f644f-b59f-4c78-8ff1-57e2178be390 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:18.049120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f644f-b59f-4c78-8ff1-57e2178be390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:18.049395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f644f-b59f-4c78-8ff1-57e2178be390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:18.050048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f644f-b59f-4c78-8ff1-57e2178be390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:18.051813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f644f-b59f-4c78-8ff1-57e2178be390 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:18.064882 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1271/2545] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:18.071958 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0b20-0f53-4507-b4c1-7c033861641b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:18.085447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0b20-0f53-4507-b4c1-7c033861641b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:18.090897 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea898f0-4414-4b4c-a481-fc4a72a9288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:18.091603 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea898f0-4414-4b4c-a481-fc4a72a9288f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:18.091924 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea898f0-4414-4b4c-a481-fc4a72a9288f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:18.092304 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea898f0-4414-4b4c-a481-fc4a72a9288f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:18.093142 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea898f0-4414-4b4c-a481-fc4a72a9288f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:18.094973 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea898f0-4414-4b4c-a481-fc4a72a9288f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:18.117140 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1275/2546] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:18.121850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f644f-b59f-4c78-8ff1-57e2178be390 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:18.132239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f644f-b59f-4c78-8ff1-57e2178be390 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:18.137825 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:18.138471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:18.138794 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:18.139073 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] PATH_INFO: `/v3/projects/2172abef4add424186e1512af034a357/users/4f4f46e7b4ae48258bc306158f8cbe6b/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:18.162143 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2172abef4add424186e1512af034a357, user_id=4f4f46e7b4ae48258bc306158f8cbe6b, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:18.164892 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:18.184586 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1272/2547] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:06:18 2022] PUT /identity/v3/projects/2172abef4add424186e1512af034a357/users/4f4f46e7b4ae48258bc306158f8cbe6b/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:18.194875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0473e7-2a81-4c84-ba09-8f2e5efaac82 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:18.195190 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0473e7-2a81-4c84-ba09-8f2e5efaac82 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:18.195444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0473e7-2a81-4c84-ba09-8f2e5efaac82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:18.242764 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5d0473e7-2a81-4c84-ba09-8f2e5efaac82 None None] MFA Rules not processed for user `4f4f46e7b4ae48258bc306158f8cbe6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:18.247255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5d0473e7-2a81-4c84-ba09-8f2e5efaac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:18.333659 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1276/2548] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:18.346717 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:18.348752 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:18.436501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9acc64-a317-4e7f-bd9a-cfd94be946aa admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:18.440142 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48eb20-6ea3-4466-8642-4726eaedd2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:18.440743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48eb20-6ea3-4466-8642-4726eaedd2ca service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:18.441018 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48eb20-6ea3-4466-8642-4726eaedd2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:18.441290 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48eb20-6ea3-4466-8642-4726eaedd2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:18.451072 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48eb20-6ea3-4466-8642-4726eaedd2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:18.452509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48eb20-6ea3-4466-8642-4726eaedd2ca service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:18.462866 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1273/2549] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:23.847501 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0473e7-2a81-4c84-ba09-8f2e5efaac82 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:23.959837 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0473e7-2a81-4c84-ba09-8f2e5efaac82 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:23.968662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:23.968662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:23.968662 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:23.969455 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] PATH_INFO: `/v3/users/4f4f46e7b4ae48258bc306158f8cbe6b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:23.971062 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4f46e7b4ae48258bc306158f8cbe6b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:23.973175 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:24.091772 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4f46e7b4ae48258bc306158f8cbe6b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.092450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4f46e7b4ae48258bc306158f8cbe6b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.100311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4f46e7b4ae48258bc306158f8cbe6b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.114634 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4f46e7b4ae48258bc306158f8cbe6b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.115989 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4f46e7b4ae48258bc306158f8cbe6b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.120531 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:24.133526 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1277/2550] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:06:23 2022] DELETE /identity/v3/users/4f4f46e7b4ae48258bc306158f8cbe6b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:24.138253 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6957aad-e0c2-41fe-9ae7-f63145532421 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:24.138969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6957aad-e0c2-41fe-9ae7-f63145532421 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:24.138969 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6957aad-e0c2-41fe-9ae7-f63145532421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:24.164269 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d6957aad-e0c2-41fe-9ae7-f63145532421 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:24.165625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d6957aad-e0c2-41fe-9ae7-f63145532421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:24.233861 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1274/2551] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:06:24.244104 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:24.245574 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:24.314960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a999aed-4f43-42cb-bd4f-e1a1821506b7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:24.319041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:24.319962 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:24.320248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:24.320522 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:24.335231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:24.336694 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:24.356690 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1278/2552] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:24.667092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6957aad-e0c2-41fe-9ae7-f63145532421 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:24.668561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d6957aad-e0c2-41fe-9ae7-f63145532421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:24.688213 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6957aad-e0c2-41fe-9ae7-f63145532421 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:24.694203 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:24.694858 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:24.695042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:24.695360 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] PATH_INFO: `/v3/projects/2172abef4add424186e1512af034a357` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:24.696394 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2172abef4add424186e1512af034a357)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:24.699492 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:24.726434 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:24.772156 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2172abef4add424186e1512af034a357', 'request_id': 'req-2e3851df-f955-4194-b8cf-ebc7037e5b64'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.779535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2172abef4add424186e1512af034a357', 'request_id': 'req-2e3851df-f955-4194-b8cf-ebc7037e5b64'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.787507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2172abef4add424186e1512af034a357', 'request_id': 'req-2e3851df-f955-4194-b8cf-ebc7037e5b64'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.800031 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] The token cache is being invalidate because project 2172abef4add424186e1512af034a357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:24.800317 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.800928 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3851df-f955-4194-b8cf-ebc7037e5b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:24.802393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1275/2553] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:24 2022] DELETE /identity/v3/projects/2172abef4add424186e1512af034a357 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:34.344394 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=28 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:34.797089 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:36.375362 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:36.376778 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:36.389490 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a070-85c5-4ff8-9113-b4d0df1cfbae service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:36.447153 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:36.447711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:36.447992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:36.448263 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] PATH_INFO: `/v3/users/0b828b4bcd9c4915846b36e45f1bf499` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:36.449403 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b828b4bcd9c4915846b36e45f1bf499)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:36.451432 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:36.498445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b828b4bcd9c4915846b36e45f1bf499'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:36.499121 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b828b4bcd9c4915846b36e45f1bf499'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:36.506098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b828b4bcd9c4915846b36e45f1bf499'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:36.518130 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b828b4bcd9c4915846b36e45f1bf499'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:36.518800 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b828b4bcd9c4915846b36e45f1bf499'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:36.531868 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1279/2554] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:06:36 2022] DELETE /identity/v3/users/0b828b4bcd9c4915846b36e45f1bf499 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:36.536258 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eace76-9bb9-436e-ab3f-1b3df0b38fb8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:36.536762 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eace76-9bb9-436e-ab3f-1b3df0b38fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:36.536865 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eace76-9bb9-436e-ab3f-1b3df0b38fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:36.556467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d0eace76-9bb9-436e-ab3f-1b3df0b38fb8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:36.557649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d0eace76-9bb9-436e-ab3f-1b3df0b38fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:36.616770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1276/2555] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:36.626540 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:36.627986 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:36.688351 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb736d2b-e5ab-4383-b792-9d2aa702299d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:36.692100 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78617acb-d42d-4c64-af44-cfcf6d265542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:36.692711 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617acb-d42d-4c64-af44-cfcf6d265542 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:36.692993 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617acb-d42d-4c64-af44-cfcf6d265542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:36.693267 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617acb-d42d-4c64-af44-cfcf6d265542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:36.703691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78617acb-d42d-4c64-af44-cfcf6d265542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:36.705131 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78617acb-d42d-4c64-af44-cfcf6d265542 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:36.716453 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1280/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:36.986372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eace76-9bb9-436e-ab3f-1b3df0b38fb8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:36.988644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d0eace76-9bb9-436e-ab3f-1b3df0b38fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:37.005238 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eace76-9bb9-436e-ab3f-1b3df0b38fb8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.011239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.012012 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.012807 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.013154 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] PATH_INFO: `/v3/projects/dba01ab407314611a2a53ed6f163a204` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.014405 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba01ab407314611a2a53ed6f163a204)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.016368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.067813 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba01ab407314611a2a53ed6f163a204', 'request_id': 'req-50287e25-7338-4a14-890b-2a752523f39a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.074486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba01ab407314611a2a53ed6f163a204', 'request_id': 'req-50287e25-7338-4a14-890b-2a752523f39a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.081846 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba01ab407314611a2a53ed6f163a204', 'request_id': 'req-50287e25-7338-4a14-890b-2a752523f39a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.096654 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] The token cache is being invalidate because project dba01ab407314611a2a53ed6f163a204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:37.096943 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.097561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-50287e25-7338-4a14-890b-2a752523f39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.102782 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1277/2557] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:36 2022] DELETE /identity/v3/projects/dba01ab407314611a2a53ed6f163a204 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:37.104489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311310df-19d0-40c9-8842-4eec8c1d5f6b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.104725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311310df-19d0-40c9-8842-4eec8c1d5f6b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.105052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311310df-19d0-40c9-8842-4eec8c1d5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.126420 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-311310df-19d0-40c9-8842-4eec8c1d5f6b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:37.127753 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-311310df-19d0-40c9-8842-4eec8c1d5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:37.146987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:37.194033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1281/2558] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:06:37.202241 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe201c-fdfb-4a4a-872f-ba0174cd5180 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.202546 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe201c-fdfb-4a4a-872f-ba0174cd5180 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.202850 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe201c-fdfb-4a4a-872f-ba0174cd5180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.222358 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4efe201c-fdfb-4a4a-872f-ba0174cd5180 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:37.223597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4efe201c-fdfb-4a4a-872f-ba0174cd5180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:37.231876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1278/2559] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:37.236324 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311310df-19d0-40c9-8842-4eec8c1d5f6b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:37.246577 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311310df-19d0-40c9-8842-4eec8c1d5f6b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.251098 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.251691 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.251966 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.252234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.252905 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:06:37.253204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.254803 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.267025 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1282/2560] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 17:06:37.271285 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe201c-fdfb-4a4a-872f-ba0174cd5180 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:37.280748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe201c-fdfb-4a4a-872f-ba0174cd5180 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.285421 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe289-2947-4b87-928b-12295a90d071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.286067 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe289-2947-4b87-928b-12295a90d071 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.286320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe289-2947-4b87-928b-12295a90d071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.286628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe289-2947-4b87-928b-12295a90d071 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.287256 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfe289-2947-4b87-928b-12295a90d071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.289141 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfe289-2947-4b87-928b-12295a90d071 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.316637 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1279/2561] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:06:37 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:06:37.320936 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:37.332011 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681d6a-47c4-4239-8813-fd15b523940d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.389640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607632d-9dad-4447-97b9-45cd09d40d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.390341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607632d-9dad-4447-97b9-45cd09d40d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.390494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607632d-9dad-4447-97b9-45cd09d40d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.390805 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607632d-9dad-4447-97b9-45cd09d40d46 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.391433 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607632d-9dad-4447-97b9-45cd09d40d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.393369 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607632d-9dad-4447-97b9-45cd09d40d46 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.415169 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1283/2562] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:06:37 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 17:06:37.419462 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe289-2947-4b87-928b-12295a90d071 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:37.429761 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe289-2947-4b87-928b-12295a90d071 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.435273 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055c83-b696-4e08-bebf-e6c94a469381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.435856 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055c83-b696-4e08-bebf-e6c94a469381 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.436135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055c83-b696-4e08-bebf-e6c94a469381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.436437 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055c83-b696-4e08-bebf-e6c94a469381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.437106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055c83-b696-4e08-bebf-e6c94a469381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.438738 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055c83-b696-4e08-bebf-e6c94a469381 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.449829 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1280/2563] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:37.453513 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607632d-9dad-4447-97b9-45cd09d40d46 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:37.463307 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607632d-9dad-4447-97b9-45cd09d40d46 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.467817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4e5e8-3127-4cdf-82f2-b315fbe8065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.468395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4e5e8-3127-4cdf-82f2-b315fbe8065d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.468670 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4e5e8-3127-4cdf-82f2-b315fbe8065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.468944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4e5e8-3127-4cdf-82f2-b315fbe8065d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.469576 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4e5e8-3127-4cdf-82f2-b315fbe8065d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.471208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4e5e8-3127-4cdf-82f2-b315fbe8065d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.482034 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1284/2564] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:37.486624 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055c83-b696-4e08-bebf-e6c94a469381 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:37.497363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055c83-b696-4e08-bebf-e6c94a469381 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.502147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.502851 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.503132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.503409 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] PATH_INFO: `/v3/projects/2710775ba2b8433197c077f0340ee3b0/users/f3d97534986a4e2eaf320a6272509e5f/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.518086 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2710775ba2b8433197c077f0340ee3b0, user_id=f3d97534986a4e2eaf320a6272509e5f, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.520803 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.533535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1281/2565] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:06:37 2022] PUT /identity/v3/projects/2710775ba2b8433197c077f0340ee3b0/users/f3d97534986a4e2eaf320a6272509e5f/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:06:37.545458 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a9c1-c67d-40e1-9dc5-26f6a85f503a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.545742 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a9c1-c67d-40e1-9dc5-26f6a85f503a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.546014 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a9c1-c67d-40e1-9dc5-26f6a85f503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.573920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fab4a9c1-c67d-40e1-9dc5-26f6a85f503a None None] MFA Rules not processed for user `f3d97534986a4e2eaf320a6272509e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:37.575147 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fab4a9c1-c67d-40e1-9dc5-26f6a85f503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:37.640281 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1285/2566] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:37.651721 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:37.653438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:37.675438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:37.711591 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31000-c0c1-4d3d-9046-b031e7d1853e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.715296 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121053a-0dd7-4f59-94d3-6e95c23d3f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.715897 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121053a-0dd7-4f59-94d3-6e95c23d3f02 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.716180 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121053a-0dd7-4f59-94d3-6e95c23d3f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.716456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121053a-0dd7-4f59-94d3-6e95c23d3f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.724635 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121053a-0dd7-4f59-94d3-6e95c23d3f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.726064 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121053a-0dd7-4f59-94d3-6e95c23d3f02 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.735686 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1282/2567] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:37.760847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4a9c1-c67d-40e1-9dc5-26f6a85f503a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:37.779816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:37.824937 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4a9c1-c67d-40e1-9dc5-26f6a85f503a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:37.829519 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:37.830146 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.830428 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.830734 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] PATH_INFO: `/v3/users/f3d97534986a4e2eaf320a6272509e5f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.831875 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d97534986a4e2eaf320a6272509e5f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:37.833789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:37.879575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d97534986a4e2eaf320a6272509e5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.880268 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d97534986a4e2eaf320a6272509e5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.887717 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d97534986a4e2eaf320a6272509e5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.900416 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d97534986a4e2eaf320a6272509e5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.901204 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d97534986a4e2eaf320a6272509e5f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:37.913944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1286/2568] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:06:37 2022] DELETE /identity/v3/users/f3d97534986a4e2eaf320a6272509e5f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:37.919174 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fc05a-3373-40f4-bfd6-9d652f4e4858 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:37.919471 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fc05a-3373-40f4-bfd6-9d652f4e4858 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:37.919748 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fc05a-3373-40f4-bfd6-9d652f4e4858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:37.938914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ba2fc05a-3373-40f4-bfd6-9d652f4e4858 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:37.940046 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ba2fc05a-3373-40f4-bfd6-9d652f4e4858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:37.999300 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1283/2569] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:38.008920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.010476 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:38.068825 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208faf7-2d95-49f9-bc57-725404ab4005 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.072847 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184840a9-7b97-4754-8ebf-d60e082bca6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.073445 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184840a9-7b97-4754-8ebf-d60e082bca6a service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.073721 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184840a9-7b97-4754-8ebf-d60e082bca6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.073992 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184840a9-7b97-4754-8ebf-d60e082bca6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.082957 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184840a9-7b97-4754-8ebf-d60e082bca6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.084408 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184840a9-7b97-4754-8ebf-d60e082bca6a service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.094328 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1287/2570] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:06:38.370914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fc05a-3373-40f4-bfd6-9d652f4e4858 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.372378 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ba2fc05a-3373-40f4-bfd6-9d652f4e4858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:38.384634 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fc05a-3373-40f4-bfd6-9d652f4e4858 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.390249 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.390914 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.391194 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.391466 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] PATH_INFO: `/v3/projects/2710775ba2b8433197c077f0340ee3b0` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.392604 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2710775ba2b8433197c077f0340ee3b0)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.394535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.444990 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2710775ba2b8433197c077f0340ee3b0', 'request_id': 'req-806bbb95-4477-452a-930f-6046c36aab46'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:38.451902 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2710775ba2b8433197c077f0340ee3b0', 'request_id': 'req-806bbb95-4477-452a-930f-6046c36aab46'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:38.461770 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2710775ba2b8433197c077f0340ee3b0', 'request_id': 'req-806bbb95-4477-452a-930f-6046c36aab46'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:38.476330 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] The token cache is being invalidate because project 2710775ba2b8433197c077f0340ee3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:06:38.476628 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:38.477271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:06:38.479367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1284/2571] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:06:38 2022] DELETE /identity/v3/projects/2710775ba2b8433197c077f0340ee3b0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 17:06:38.484807 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9189c9-8c03-4a00-b87d-2f2560855560 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.485269 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9189c9-8c03-4a00-b87d-2f2560855560 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.485368 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9189c9-8c03-4a00-b87d-2f2560855560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.507242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ee9189c9-8c03-4a00-b87d-2f2560855560 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:38.507415 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.508441 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ee9189c9-8c03-4a00-b87d-2f2560855560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:38.508685 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:38.541866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:38.565488 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:38.572362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bbb95-4477-452a-930f-6046c36aab46 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.574387 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1288/2572] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:38.576840 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.577515 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.578042 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.578320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.580147 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:38.582067 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38fdc-149d-4381-b0ef-ab4babf3c6ae None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.582357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38fdc-149d-4381-b0ef-ab4babf3c6ae None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.582676 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb38fdc-149d-4381-b0ef-ab4babf3c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.602700 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-abb38fdc-149d-4381-b0ef-ab4babf3c6ae None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:38.604192 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-abb38fdc-149d-4381-b0ef-ab4babf3c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:38.612804 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1289/2573] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 17:06:38.617960 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb38fdc-149d-4381-b0ef-ab4babf3c6ae None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.628261 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb38fdc-149d-4381-b0ef-ab4babf3c6ae None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.633623 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.634830 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.635108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.635376 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.636013 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 17:06:38.636311 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.637882 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.646291 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.647766 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.649817 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1290/2574] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Oct 10 17:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 17:06:38.654138 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.657740 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1285/2575] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:38.663900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126120c-2a7d-424c-acea-4eadf5b02bf7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.668503 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87a418-1654-4853-8ac3-2be5dce45b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.669091 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87a418-1654-4853-8ac3-2be5dce45b66 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.669367 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87a418-1654-4853-8ac3-2be5dce45b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.669639 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87a418-1654-4853-8ac3-2be5dce45b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.670272 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87a418-1654-4853-8ac3-2be5dce45b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.672173 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87a418-1654-4853-8ac3-2be5dce45b66 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.702911 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1291/2576] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Oct 10 17:06:38 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:06:38.704500 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.716532 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c062227-ad63-418e-bc13-4571e153c5ba service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.776743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e31a-8361-4025-b37c-8460f8e9812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.777347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e31a-8361-4025-b37c-8460f8e9812a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.777625 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e31a-8361-4025-b37c-8460f8e9812a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.777893 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e31a-8361-4025-b37c-8460f8e9812a admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.778551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482e31a-8361-4025-b37c-8460f8e9812a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.780588 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482e31a-8361-4025-b37c-8460f8e9812a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.806678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1286/2577] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Oct 10 17:06:38 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 17:06:38.807970 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87a418-1654-4853-8ac3-2be5dce45b66 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.818357 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87a418-1654-4853-8ac3-2be5dce45b66 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.823769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cb84a-440c-441d-9391-912bba65015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.824373 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb84a-440c-441d-9391-912bba65015d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.824653 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb84a-440c-441d-9391-912bba65015d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.824931 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb84a-440c-441d-9391-912bba65015d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.825605 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cb84a-440c-441d-9391-912bba65015d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.827212 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cb84a-440c-441d-9391-912bba65015d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.841699 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1292/2578] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:38.842871 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e31a-8361-4025-b37c-8460f8e9812a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.854410 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e31a-8361-4025-b37c-8460f8e9812a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.859507 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573012a-4bdd-4334-a21d-19acda166ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.860120 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573012a-4bdd-4334-a21d-19acda166ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.860384 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573012a-4bdd-4334-a21d-19acda166ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.860652 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573012a-4bdd-4334-a21d-19acda166ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.861323 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573012a-4bdd-4334-a21d-19acda166ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.862946 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573012a-4bdd-4334-a21d-19acda166ac1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.873650 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1287/2579] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 10 17:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 17:06:38.877943 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cb84a-440c-441d-9391-912bba65015d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:38.888731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cb84a-440c-441d-9391-912bba65015d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:38.897415 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:38.898144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.898575 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.898894 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] PATH_INFO: `/v3/projects/afbff92bb4c94dc0a81c6b8693bc0029/users/e3d37b3aff4a4ebdabf093ca843d9382/roles/f9fed2e211414db0aa72e25fcc59d6f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.915980 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbff92bb4c94dc0a81c6b8693bc0029, user_id=e3d37b3aff4a4ebdabf093ca843d9382, role_id=f9fed2e211414db0aa72e25fcc59d6f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:38.918769 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:38.933139 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1293/2580] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Oct 10 17:06:38 2022] PUT /identity/v3/projects/afbff92bb4c94dc0a81c6b8693bc0029/users/e3d37b3aff4a4ebdabf093ca843d9382/roles/f9fed2e211414db0aa72e25fcc59d6f8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:06:38.938589 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7c958-d922-4878-becc-a3ec53a3e43f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:38.939122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7c958-d922-4878-becc-a3ec53a3e43f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:38.939402 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7c958-d922-4878-becc-a3ec53a3e43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:38.959346 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9ee7c958-d922-4878-becc-a3ec53a3e43f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:38.960484 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9ee7c958-d922-4878-becc-a3ec53a3e43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:39.022177 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1288/2581] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:39.032983 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:39.034995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:39.094673 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc2173-61f4-4f08-8e20-3f8447e3372a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:39.098310 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:39.098950 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:39.099231 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:39.099511 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:39.109777 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:39.111274 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:39.121041 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1294/2582] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:40.381095 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49409dd-45da-4ff1-8dcd-a00213cc8cc3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:40.381565 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49409dd-45da-4ff1-8dcd-a00213cc8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:40.381665 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49409dd-45da-4ff1-8dcd-a00213cc8cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:40.414504 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d49409dd-45da-4ff1-8dcd-a00213cc8cc3 None None] MFA Rules not processed for user `e3d37b3aff4a4ebdabf093ca843d9382`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:40.416088 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d49409dd-45da-4ff1-8dcd-a00213cc8cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:40.420259 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:40.495509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1289/2583] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:40.506981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:40.508494 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:40.573221 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ca3e-d279-42cf-bf71-81128ede158c service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:40.576765 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca42dd-7e0c-4fa9-84d0-d58c13a195cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc38841128043d0bd618275c77bbf5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:40.577361 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca42dd-7e0c-4fa9-84d0-d58c13a195cf service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:40.577640 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca42dd-7e0c-4fa9-84d0-d58c13a195cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:40.577913 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca42dd-7e0c-4fa9-84d0-d58c13a195cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:40.586444 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca42dd-7e0c-4fa9-84d0-d58c13a195cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:40.587987 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca42dd-7e0c-4fa9-84d0-d58c13a195cf service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:40.596862 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1295/2584] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:06:40.797784 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49409dd-45da-4ff1-8dcd-a00213cc8cc3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:06:40.799376 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d49409dd-45da-4ff1-8dcd-a00213cc8cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:40.930439 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49409dd-45da-4ff1-8dcd-a00213cc8cc3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:06:40.944561 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebac4f-64df-4028-8799-bdfbe5c62b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:06:40.945395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebac4f-64df-4028-8799-bdfbe5c62b88 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:40.947372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebac4f-64df-4028-8799-bdfbe5c62b88 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:40.947372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebac4f-64df-4028-8799-bdfbe5c62b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:40.955424 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d4ebac4f-64df-4028-8799-bdfbe5c62b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:40.973743 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebac4f-64df-4028-8799-bdfbe5c62b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:06:40.975029 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebac4f-64df-4028-8799-bdfbe5c62b88 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:06:40.990674 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1290/2585] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:06:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:06:42.028149 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15783f-2bf1-407e-a127-0d8b498fb321 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:06:42.028689 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15783f-2bf1-407e-a127-0d8b498fb321 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:06:42.029075 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15783f-2bf1-407e-a127-0d8b498fb321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:06:42.048933 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cd15783f-2bf1-407e-a127-0d8b498fb321 None None] MFA Rules not processed for user `e3d37b3aff4a4ebdabf093ca843d9382`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:06:42.050133 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cd15783f-2bf1-407e-a127-0d8b498fb321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:06:42.058052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1296/2586] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:06:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:06:50.983447 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=59 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:06:52.043396 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:07:09.860925 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00233d72-4232-450e-9c25-bff1c779ff51 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:09.861516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00233d72-4232-450e-9c25-bff1c779ff51 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:09.861516 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00233d72-4232-450e-9c25-bff1c779ff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:09.942125 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-00233d72-4232-450e-9c25-bff1c779ff51 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:09.943372 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-00233d72-4232-450e-9c25-bff1c779ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:09.992393 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1291/2587] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:10.031020 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15783f-2bf1-407e-a127-0d8b498fb321 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:10.091568 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15783f-2bf1-407e-a127-0d8b498fb321 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:10.097241 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:10.097849 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:10.098161 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:10.098436 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:10.107447 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:10.109286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:10.118806 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1297/2588] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 17:07:12.919362 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477010-4a7f-486e-b88b-f2156e669b71 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:12.919810 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477010-4a7f-486e-b88b-f2156e669b71 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:12.919933 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477010-4a7f-486e-b88b-f2156e669b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:12.940048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0d477010-4a7f-486e-b88b-f2156e669b71 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:12.941230 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0d477010-4a7f-486e-b88b-f2156e669b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:12.948854 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1292/2589] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:12.970144 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:12.971615 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:13.000280 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15212933-e1d2-41b8-9edc-7661c9cbdb46 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:13.005824 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e791e-920e-41a4-8ba2-acfe9dee6b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:13.006421 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e791e-920e-41a4-8ba2-acfe9dee6b60 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:13.006737 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e791e-920e-41a4-8ba2-acfe9dee6b60 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:13.007017 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e791e-920e-41a4-8ba2-acfe9dee6b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:13.015208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e791e-920e-41a4-8ba2-acfe9dee6b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:13.016782 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e791e-920e-41a4-8ba2-acfe9dee6b60 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:13.026489 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1298/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:16.190751 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6136b1-6a14-4d5e-8de2-d97311298f6b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:16.191302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6136b1-6a14-4d5e-8de2-d97311298f6b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:16.191302 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6136b1-6a14-4d5e-8de2-d97311298f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:16.210137 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5a6136b1-6a14-4d5e-8de2-d97311298f6b None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:16.211363 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5a6136b1-6a14-4d5e-8de2-d97311298f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:16.220028 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1293/2591] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:16.242331 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e791e-920e-41a4-8ba2-acfe9dee6b60 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:16.254044 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e791e-920e-41a4-8ba2-acfe9dee6b60 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:16.259442 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964d4ac-41a6-46ab-8135-4167ec9e42c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:16.260033 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964d4ac-41a6-46ab-8135-4167ec9e42c8 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:16.260336 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964d4ac-41a6-46ab-8135-4167ec9e42c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:16.260610 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964d4ac-41a6-46ab-8135-4167ec9e42c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:16.268995 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964d4ac-41a6-46ab-8135-4167ec9e42c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:16.270579 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964d4ac-41a6-46ab-8135-4167ec9e42c8 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:16.280687 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1299/2592] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:19.256033 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c0106-1b23-4884-a8b5-6cb9009e17c8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:19.256535 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c0106-1b23-4884-a8b5-6cb9009e17c8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:19.256644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c0106-1b23-4884-a8b5-6cb9009e17c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:19.276450 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1c4c0106-1b23-4884-a8b5-6cb9009e17c8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:19.278644 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1c4c0106-1b23-4884-a8b5-6cb9009e17c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:19.286438 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1294/2593] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:19.321596 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964d4ac-41a6-46ab-8135-4167ec9e42c8 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:19.333965 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964d4ac-41a6-46ab-8135-4167ec9e42c8 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:19.340239 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4566c3-082c-4020-ae4e-aca789d4fe50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:19.341016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4566c3-082c-4020-ae4e-aca789d4fe50 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:19.341294 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4566c3-082c-4020-ae4e-aca789d4fe50 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:19.341561 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4566c3-082c-4020-ae4e-aca789d4fe50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:19.349730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4566c3-082c-4020-ae4e-aca789d4fe50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:19.351316 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4566c3-082c-4020-ae4e-aca789d4fe50 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:19.361745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1300/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:22.420299 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfacdf9-705c-4cca-9ae6-38c6a63f560a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:22.420763 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfacdf9-705c-4cca-9ae6-38c6a63f560a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:22.420876 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfacdf9-705c-4cca-9ae6-38c6a63f560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:22.440657 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7dfacdf9-705c-4cca-9ae6-38c6a63f560a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:22.441874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7dfacdf9-705c-4cca-9ae6-38c6a63f560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:22.451091 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1295/2595] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:22.488068 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4566c3-082c-4020-ae4e-aca789d4fe50 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:22.500038 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4566c3-082c-4020-ae4e-aca789d4fe50 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:22.505514 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b641ef-1169-4e59-9767-772050499959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:22.506108 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b641ef-1169-4e59-9767-772050499959 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:22.506393 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b641ef-1169-4e59-9767-772050499959 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:22.506693 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b641ef-1169-4e59-9767-772050499959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:22.516092 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b641ef-1169-4e59-9767-772050499959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:22.517664 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b641ef-1169-4e59-9767-772050499959 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:22.528346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1301/2596] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:25.575133 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0cf05-147d-40a8-a1fb-8158e186c81f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:25.575597 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0cf05-147d-40a8-a1fb-8158e186c81f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:25.575705 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0cf05-147d-40a8-a1fb-8158e186c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:25.595456 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-67e0cf05-147d-40a8-a1fb-8158e186c81f None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:25.596678 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-67e0cf05-147d-40a8-a1fb-8158e186c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:25.604433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1296/2597] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:25.640208 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b641ef-1169-4e59-9767-772050499959 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:25.651248 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b641ef-1169-4e59-9767-772050499959 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:25.657312 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71472be0-7fd7-4fc3-b49d-952ef3a269c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:25.657900 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71472be0-7fd7-4fc3-b49d-952ef3a269c6 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:25.658177 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71472be0-7fd7-4fc3-b49d-952ef3a269c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:25.658450 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71472be0-7fd7-4fc3-b49d-952ef3a269c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:25.666360 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71472be0-7fd7-4fc3-b49d-952ef3a269c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:25.668069 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71472be0-7fd7-4fc3-b49d-952ef3a269c6 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:25.677233 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1302/2598] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:35.589648 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=60 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:07:35.673157 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=62 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:07:35.932455 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0cf05-147d-40a8-a1fb-8158e186c81f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:35.934286 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-67e0cf05-147d-40a8-a1fb-8158e186c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:36.027150 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0cf05-147d-40a8-a1fb-8158e186c81f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:36.033132 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:36.033730 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:36.034009 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:36.034310 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:36.036081 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:36.047940 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:36.049518 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:36.059804 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1297/2599] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:40.677326 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc0ae-fa74-47da-9b51-c6c2b7069d70 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:40.677866 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc0ae-fa74-47da-9b51-c6c2b7069d70 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:40.677969 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc0ae-fa74-47da-9b51-c6c2b7069d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:40.697944 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-76bfc0ae-fa74-47da-9b51-c6c2b7069d70 None None] MFA Rules not processed for user `e3d37b3aff4a4ebdabf093ca843d9382`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:40.699188 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-76bfc0ae-fa74-47da-9b51-c6c2b7069d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:40.705974 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1303/2600] 10.222.0.27 () {58 vars in 958 bytes} [Mon Oct 10 17:07:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:40.941942 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:40.960356 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06082cd8-8642-4df2-9fcd-9f07ba8c7572 service placement] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:40.963929 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d805106909465abd09c0daf5ecc1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:40.964511 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:40.964786 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:40.965058 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:40.967426 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:40.989621 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:40.991083 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:40.998968 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1298/2601] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:50.693004 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:07:50.995368 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=56 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:07:53.610156 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8c008-892f-432c-b51d-36c1f395c7ea None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:53.610741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8c008-892f-432c-b51d-36c1f395c7ea None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:53.610741 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8c008-892f-432c-b51d-36c1f395c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:53.632097 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-caa8c008-892f-432c-b51d-36c1f395c7ea None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:53.633296 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-caa8c008-892f-432c-b51d-36c1f395c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:53.641006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1304/2602] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:53.676268 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:53.690240 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ed97-6eee-44ad-9ba0-1c5456a44ad8 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:53.695639 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3f53-dea8-4e5a-b96c-1e6e5638195d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:53.696226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3f53-dea8-4e5a-b96c-1e6e5638195d service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:53.696499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3f53-dea8-4e5a-b96c-1e6e5638195d service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:53.696767 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3f53-dea8-4e5a-b96c-1e6e5638195d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:53.704869 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a3f53-dea8-4e5a-b96c-1e6e5638195d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:53.706428 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a3f53-dea8-4e5a-b96c-1e6e5638195d service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:53.715649 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1299/2603] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:56.871819 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a05997-870e-4843-83aa-5d6e205bbb91 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:56.872389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a05997-870e-4843-83aa-5d6e205bbb91 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:56.872389 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a05997-870e-4843-83aa-5d6e205bbb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:56.892982 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-01a05997-870e-4843-83aa-5d6e205bbb91 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:56.894201 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-01a05997-870e-4843-83aa-5d6e205bbb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:56.902168 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1305/2604] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:07:56.927149 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3f53-dea8-4e5a-b96c-1e6e5638195d service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:07:56.939048 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3f53-dea8-4e5a-b96c-1e6e5638195d service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:07:56.944661 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bea81-9483-4094-9043-f6bd0a2c1e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:07:56.945239 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bea81-9483-4094-9043-f6bd0a2c1e40 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:56.945519 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bea81-9483-4094-9043-f6bd0a2c1e40 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:56.945795 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bea81-9483-4094-9043-f6bd0a2c1e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:56.954271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bea81-9483-4094-9043-f6bd0a2c1e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:07:56.955884 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bea81-9483-4094-9043-f6bd0a2c1e40 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:07:56.965250 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1300/2605] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:07:59.952162 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81e3a5-ee36-4dfd-9276-34dca13b115a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:07:59.952671 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81e3a5-ee36-4dfd-9276-34dca13b115a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:07:59.952780 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81e3a5-ee36-4dfd-9276-34dca13b115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:07:59.973745 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6d81e3a5-ee36-4dfd-9276-34dca13b115a None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:07:59.974968 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6d81e3a5-ee36-4dfd-9276-34dca13b115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:07:59.982888 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1306/2606] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:08:00.005681 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bea81-9483-4094-9043-f6bd0a2c1e40 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:00.018276 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bea81-9483-4094-9043-f6bd0a2c1e40 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:00.023951 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748d003-6706-4271-93ee-af9498cdbb46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:00.024550 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d003-6706-4271-93ee-af9498cdbb46 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:00.024832 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d003-6706-4271-93ee-af9498cdbb46 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:00.025106 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d003-6706-4271-93ee-af9498cdbb46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:00.033855 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748d003-6706-4271-93ee-af9498cdbb46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:00.035473 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748d003-6706-4271-93ee-af9498cdbb46 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:00.044834 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1301/2607] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:08:03.112262 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53265-98e8-4f53-8cb2-50628a725ede None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:03.112781 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53265-98e8-4f53-8cb2-50628a725ede None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:03.112901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb53265-98e8-4f53-8cb2-50628a725ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:03.134036 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cfb53265-98e8-4f53-8cb2-50628a725ede None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:08:03.135242 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cfb53265-98e8-4f53-8cb2-50628a725ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:03.143554 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1307/2608] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:08:03.175468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748d003-6706-4271-93ee-af9498cdbb46 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:03.186486 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748d003-6706-4271-93ee-af9498cdbb46 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:03.192367 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60081199-6c26-49be-bbbf-7ba705635fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:03.192948 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60081199-6c26-49be-bbbf-7ba705635fcd service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:03.193226 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60081199-6c26-49be-bbbf-7ba705635fcd service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:03.193499 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60081199-6c26-49be-bbbf-7ba705635fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:03.201458 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60081199-6c26-49be-bbbf-7ba705635fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:03.203062 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60081199-6c26-49be-bbbf-7ba705635fcd service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:03.213092 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1302/2609] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:08:06.281988 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16774-73a3-43d4-8ac2-2e97a21307b8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:06.282454 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16774-73a3-43d4-8ac2-2e97a21307b8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:06.282669 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16774-73a3-43d4-8ac2-2e97a21307b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:06.302920 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f2c16774-73a3-43d4-8ac2-2e97a21307b8 None None] MFA Rules not processed for user `7e37cdb10c97478cae45037ee23ff133`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:08:06.304253 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f2c16774-73a3-43d4-8ac2-2e97a21307b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:06.312429 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1308/2610] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Oct 10 17:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:08:06.343527 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60081199-6c26-49be-bbbf-7ba705635fcd service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:06.355440 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60081199-6c26-49be-bbbf-7ba705635fcd service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:06.361787 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78b5bbfc207243febee44e0d7cacb7b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:06.363347 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:06.363501 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:06.363732 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:06.373576 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:06.376135 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:06.388508 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1303/2611] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:08:16.297341 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=15 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:16.383698 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=30 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:19.857492 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4db2a-5bd2-4970-9113-a78ab4c5883e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:19.857921 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4db2a-5bd2-4970-9113-a78ab4c5883e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:19.858052 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4db2a-5bd2-4970-9113-a78ab4c5883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:19.887618 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d4a4db2a-5bd2-4970-9113-a78ab4c5883e None None] MFA Rules not processed for user `0bda53b55a944877893a20c799fb7c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 17:08:19.888835 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4a4db2a-5bd2-4970-9113-a78ab4c5883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:19.945417 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1309/2612] 10.222.0.27 () {58 vars in 967 bytes} [Mon Oct 10 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 17:08:19.985608 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:19.987101 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:20.058620 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91ece-00a3-455a-bcf5-40c57be2724c service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:20.064277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee9a6828d334114bb3a7ae391960bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:20.064881 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:20.065164 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:20.065442 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:20.073554 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:20.075182 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:20.084002 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1304/2613] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Oct 10 17:08:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 17:08:23.338395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4db2a-5bd2-4970-9113-a78ab4c5883e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:23.358015 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4db2a-5bd2-4970-9113-a78ab4c5883e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:23.366452 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:23.367216 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:23.367716 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:23.368451 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:23.370851 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:23.386066 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:23.389225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:23.424789 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1310/2614] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:08:26.821271 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:26.822874 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:26.839551 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8637da9-c0f8-45d0-9db6-e8d7fc6a3a8b service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:26.845342 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:26.845977 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:26.846262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:26.846578 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] PATH_INFO: `/v3/users/04a1c69123f248399e57b4f77ebf61bc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:26.847727 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a1c69123f248399e57b4f77ebf61bc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:26.849679 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:26.898599 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a1c69123f248399e57b4f77ebf61bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:26.911289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a1c69123f248399e57b4f77ebf61bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:26.918151 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a1c69123f248399e57b4f77ebf61bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:26.918852 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a1c69123f248399e57b4f77ebf61bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:26.926068 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a1c69123f248399e57b4f77ebf61bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:26.931912 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1305/2615] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:08:26 2022] DELETE /identity/v3/users/04a1c69123f248399e57b4f77ebf61bc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:08:27.107056 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:27.118730 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6e2ed-1041-4175-87f5-e55551f5ee4c service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:27.180350 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:27.180978 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:27.181255 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:27.181523 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] PATH_INFO: `/v3/projects/e3b2f137e0154f9ea45baf39b5b36245` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:27.182656 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b2f137e0154f9ea45baf39b5b36245)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:27.185053 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:27.241413 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b2f137e0154f9ea45baf39b5b36245', 'request_id': 'req-799c268f-1037-4ae7-857d-7e47f4522448'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.248016 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b2f137e0154f9ea45baf39b5b36245', 'request_id': 'req-799c268f-1037-4ae7-857d-7e47f4522448'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.254199 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b2f137e0154f9ea45baf39b5b36245', 'request_id': 'req-799c268f-1037-4ae7-857d-7e47f4522448'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.268677 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] The token cache is being invalidate because project e3b2f137e0154f9ea45baf39b5b36245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:08:27.268981 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.269606 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.271346 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1311/2616] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:08:27 2022] DELETE /identity/v3/projects/e3b2f137e0154f9ea45baf39b5b36245 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:08:27.275158 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:27.276564 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:27.289603 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e704-4240-4aab-8d34-c0c0bd54c1c9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:27.350066 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:27.350726 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:27.351005 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:27.351277 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] PATH_INFO: `/v3/users/7060db7cf84d491ba49034fbdfbdad1d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:27.352403 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7060db7cf84d491ba49034fbdfbdad1d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:27.354308 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:27.357054 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:27.412433 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7060db7cf84d491ba49034fbdfbdad1d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.425702 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7060db7cf84d491ba49034fbdfbdad1d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.432451 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7060db7cf84d491ba49034fbdfbdad1d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.433149 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7060db7cf84d491ba49034fbdfbdad1d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.442425 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7060db7cf84d491ba49034fbdfbdad1d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.451116 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1306/2617] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:08:27 2022] DELETE /identity/v3/users/7060db7cf84d491ba49034fbdfbdad1d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:08:27.639234 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:27.640731 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:27.655757 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c268f-1037-4ae7-857d-7e47f4522448 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:27.667463 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:27.720381 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:27.721006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:27.721286 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:27.721560 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] PATH_INFO: `/v3/projects/1cf210063297426bbf603fdaec71b973` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:27.722725 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf210063297426bbf603fdaec71b973)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:27.724612 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:27.770629 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf210063297426bbf603fdaec71b973', 'request_id': 'req-ec972e14-05f0-4314-81aa-fb172ba5e637'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.776666 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf210063297426bbf603fdaec71b973', 'request_id': 'req-ec972e14-05f0-4314-81aa-fb172ba5e637'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.782308 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf210063297426bbf603fdaec71b973', 'request_id': 'req-ec972e14-05f0-4314-81aa-fb172ba5e637'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.794901 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] The token cache is being invalidate because project 1cf210063297426bbf603fdaec71b973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:08:27.795191 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.795816 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:27.798023 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1312/2618] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:08:27 2022] DELETE /identity/v3/projects/1cf210063297426bbf603fdaec71b973 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:08:37.224863 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:37.226467 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:37.243289 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d224-80bd-44bd-8d0c-ad2bbd3a78b2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:37.303209 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:37.303842 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:37.304122 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:37.304395 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] PATH_INFO: `/v3/users/e3d37b3aff4a4ebdabf093ca843d9382` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:37.305509 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d37b3aff4a4ebdabf093ca843d9382)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:37.307468 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:37.356543 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d37b3aff4a4ebdabf093ca843d9382'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.368503 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d37b3aff4a4ebdabf093ca843d9382'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.375320 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d37b3aff4a4ebdabf093ca843d9382'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.375984 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d37b3aff4a4ebdabf093ca843d9382'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.383110 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d37b3aff4a4ebdabf093ca843d9382'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.385262 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:37.389971 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1307/2619] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 10 17:08:37 2022] DELETE /identity/v3/users/e3d37b3aff4a4ebdabf093ca843d9382 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:08:37.559642 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:08:37.561107 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:08:37.577481 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972e14-05f0-4314-81aa-fb172ba5e637 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:08:37.640028 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e37cdb10c97478cae45037ee23ff133', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '900946e9f4af4713b0f50c103f092bc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:08:37.640667 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:08:37.640947 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:08:37.641225 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] PATH_INFO: `/v3/projects/afbff92bb4c94dc0a81c6b8693bc0029` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:08:37.642364 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbff92bb4c94dc0a81c6b8693bc0029)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:08:37.644477 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:08:37.691102 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:08:37.694813 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbff92bb4c94dc0a81c6b8693bc0029', 'request_id': 'req-8ba79d0a-3f4f-424a-be5d-736eac46d035'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.702954 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbff92bb4c94dc0a81c6b8693bc0029', 'request_id': 'req-8ba79d0a-3f4f-424a-be5d-736eac46d035'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.709198 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbff92bb4c94dc0a81c6b8693bc0029', 'request_id': 'req-8ba79d0a-3f4f-424a-be5d-736eac46d035'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.722006 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] The token cache is being invalidate because project afbff92bb4c94dc0a81c6b8693bc0029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 17:08:37.722318 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.722902 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8ba79d0a-3f4f-424a-be5d-736eac46d035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 17:08:37.724395 dv-cinder-834540-2-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1313/2620] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 10 17:08:37 2022] DELETE /identity/v3/projects/afbff92bb4c94dc0a81c6b8693bc0029 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 17:08:47.718437 dv-cinder-834540-2-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 17:13:14.320734 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 17:13:14.322185 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:13:14.393385 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85516d80-43d4-408e-b59a-94666284f876 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 17:13:14.451955 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975b42-2e32-46b7-8a51-c0ebb993d562 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ad8898f985c41789f17984ef13bf5eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0155ef40a1c64e77b5d5e8e64498a24c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 17:13:14.452556 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975b42-2e32-46b7-8a51-c0ebb993d562 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 17:13:14.452831 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975b42-2e32-46b7-8a51-c0ebb993d562 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 17:13:14.453102 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975b42-2e32-46b7-8a51-c0ebb993d562 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 17:13:14.454904 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-21975b42-2e32-46b7-8a51-c0ebb993d562 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 17:13:14.465756 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975b42-2e32-46b7-8a51-c0ebb993d562 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 17:13:14.467349 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975b42-2e32-46b7-8a51-c0ebb993d562 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 17:13:14.477011 dv-cinder-834540-2-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1308/2621] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Oct 10 17:13:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 17:13:24.472843 dv-cinder-834540-2-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=58 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}